-- Logs begin at Tue 2022-09-20 21:44:10 UTC, end at Tue 2022-09-20 22:41:52 UTC. -- Sep 20 22:15:12.996734 dv-cinder-858276-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 20 22:15:13.004078 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 20 22:15:13.009880 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 20 22:15:13 2022] *** Sep 20 22:15:13.009880 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 20 22:15:13.009880 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 20 22:15:13.009880 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: nodename: dv-cinder-858276-1-iscsi Sep 20 22:15:13.009880 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: machine: x86_64 Sep 20 22:15:13.009880 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: clock source: unix Sep 20 22:15:13.009880 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: pcre jit disabled Sep 20 22:15:13.009880 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: detected number of CPU cores: 4 Sep 20 22:15:13.009880 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: current working directory: / Sep 20 22:15:13.009880 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: detected binary path: /usr/bin/uwsgi-core Sep 20 22:15:13.009880 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: your processes number limit is 47680 Sep 20 22:15:13.009880 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: your memory page size is 4096 bytes Sep 20 22:15:13.009880 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: detected max file descriptor number: 2048 Sep 20 22:15:13.009880 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: lock engine: pthread robust mutexes Sep 20 22:15:13.009880 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: thunder lock: enabled Sep 20 22:15:13.009880 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 20 22:15:13.009880 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 20 22:15:13.048517 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: Python main interpreter initialized at 0x557a9a2fe9c0 Sep 20 22:15:13.048517 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: python threads support enabled Sep 20 22:15:13.048517 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: your server socket listen backlog is limited to 100 connections Sep 20 22:15:13.048517 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: your mercy for graceful operations on workers is 90 seconds Sep 20 22:15:13.048932 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: mapped 403077 bytes (393 KB) for 2 cores Sep 20 22:15:13.048932 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: *** Operational MODE: preforking *** Sep 20 22:15:13.049236 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: *** uWSGI is running in multiple interpreter mode *** Sep 20 22:15:13.049236 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: spawned uWSGI master process (pid: 105475) Sep 20 22:15:13.049450 dv-cinder-858276-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 20 22:15:13.050092 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: spawned uWSGI worker 1 (pid: 105476, cores: 1) Sep 20 22:15:13.050427 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: spawned uWSGI worker 2 (pid: 105477, cores: 1) Sep 20 22:15:13.050900 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 20 22:15:13.698799 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 20 22:15:13.702243 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 20 22:15:14.773755 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 22:15:14.773755 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: from cryptography.utils import int_from_bytes Sep 20 22:15:14.774375 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 22:15:14.774375 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: from cryptography.utils import int_from_bytes Sep 20 22:15:14.775139 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 22:15:14.775139 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: from cryptography.utils import int_from_bytes Sep 20 22:15:14.775574 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 22:15:14.775574 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: from cryptography.utils import int_from_bytes Sep 20 22:15:17.229708 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 20 22:15:17.230382 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 20 22:15:17.230474 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 20 22:15:17.230814 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 20 22:15:17.231184 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 20 22:15:17.231184 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 20 22:15:17.231345 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 20 22:15:17.231439 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.231589 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 20 22:15:17.231761 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.231948 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 20 22:15:17.232085 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.232202 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 20 22:15:17.232404 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.232582 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.232736 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.232904 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.233071 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.233246 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.233392 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.233560 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.233709 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.233886 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.234039 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.234193 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.234338 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.234508 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.234645 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.234820 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.234950 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858276-1-iscsi {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.235146 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.235290 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.235400 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.235512 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.235697 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.235803 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.236015 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858276-1-iscsi {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.236113 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.236330 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.236425 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.236631 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.236727 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.237226 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.237340 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.237539 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.237801 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.237902 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.238142 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.238242 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.238442 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.238542 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.238837 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.238930 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.239696 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.239796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.240014 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.240134 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.240325 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.240439 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.240641 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.240748 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.240952 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.241050 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.241293 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.241388 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.241602 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.241695 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.241905 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.241996 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858276-1-iscsi {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.242224 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.242312 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.242529 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.242622 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.242904 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.242990 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858276-1-iscsi {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.243223 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.243312 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.243533 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.243619 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.243845 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.243991 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.244228 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.244325 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.244547 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.244653 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.244849 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.244944 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.245193 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.245333 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.245514 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.245608 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.245818 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.245918 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.246140 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.246235 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.246444 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.246531 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.246754 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.246840 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.247061 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.247157 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.247363 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.247454 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.247669 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.247762 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.247972 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.248065 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.248223 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.248310 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.248533 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.248620 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.248854 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.248939 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.249123 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.249212 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.249432 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.249519 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.249743 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.249837 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.249993 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.250081 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.250312 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.250474 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.250593 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.250690 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.250839 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.250927 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.251149 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.251248 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.251464 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.251558 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.251769 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.251862 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.252072 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.252167 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.252373 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.252466 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.252674 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.252760 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.253001 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.253105 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.253291 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.253385 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.253592 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.253685 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.253894 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.253989 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.254206 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.254293 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.254512 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.254618 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.254890 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.255501 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.255693 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.255843 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.256008 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.256107 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.256350 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.256434 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.256630 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.256722 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.256934 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.257060 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.257297 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.257384 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.257606 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.257699 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.257909 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.258007 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.258214 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.258300 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.258524 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.258621 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.258825 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.258924 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.259127 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.259214 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.259429 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.259515 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.259682 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.259768 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.259982 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.260068 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.260288 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.260380 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.260570 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.260663 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.260864 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.260952 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.261195 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.261286 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.261510 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.261598 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.261812 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.261898 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.262113 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.262207 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.262411 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.262511 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.262704 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.262791 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.263006 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.263092 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.263305 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.263401 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.263692 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.263907 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.264004 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.264204 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.264290 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.264503 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.264599 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.264800 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.264951 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.265117 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.265199 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.265413 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.265550 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.265711 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.265810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.266021 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.266118 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.266329 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.266415 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.266628 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.266721 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.266927 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.267014 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.267233 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.267327 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.267534 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.267633 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.267846 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.267933 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.268148 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.268244 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.268446 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.268610 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.268760 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.268857 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.269081 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.269170 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.269381 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.269488 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.269691 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.269785 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.269990 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.270081 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.270289 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.270384 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.270632 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.270706 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.270928 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.271003 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.271275 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.271359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.271583 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.271665 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.271885 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.271958 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.272197 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.272293 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.272480 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.272553 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.272778 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.272874 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.273098 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.273203 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.273397 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.273490 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.273693 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.273778 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.273992 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.274086 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.274286 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.274379 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.274596 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.274692 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.274910 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.275038 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.275212 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.275298 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.275515 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.275672 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.275816 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.275910 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.276128 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:15:17.276216 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.276456 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.276551 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.276779 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.276875 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.277141 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.277242 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.277451 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.277546 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.277764 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.277865 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.278084 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.278177 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.278394 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.278480 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.278703 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.278789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.279015 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.279102 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.279329 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.279423 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.279631 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.279716 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.279939 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.280026 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.280248 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.280348 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.280563 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.280651 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.280878 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.281001 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.281222 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.281317 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.281532 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.281654 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.281842 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.281929 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.282158 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.282373 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.282463 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.282543 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.282765 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.282852 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.283087 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.283176 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.283402 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.283488 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.283705 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.283804 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.284038 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.284134 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.284359 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.284445 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.284673 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.284767 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.284992 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.285080 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.285321 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.285408 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.285627 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.285726 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.285933 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.286020 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.286265 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.286353 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.286603 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.286698 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.286915 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.287009 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.287230 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.287317 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.287544 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.287630 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.287851 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.287937 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.288164 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.288250 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.288474 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.288561 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.288781 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.288868 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.289113 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.289211 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.289421 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.289509 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.289728 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.289823 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.290059 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.290146 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.290370 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.290459 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.290687 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.290790 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.290997 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.291161 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.291308 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.291401 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.291618 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.291705 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.291923 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.292016 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.292228 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.292313 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.292533 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.292631 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.292829 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.292924 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.293155 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.293243 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.293455 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.293541 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.293760 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.293863 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.294060 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.294148 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.294376 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.294464 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.294698 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.294794 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.295002 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.295090 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.295313 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.295398 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.295620 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.295718 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.295924 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.296019 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.296231 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.296322 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.296537 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.296625 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.296838 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.296925 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.297176 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.297264 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.297485 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.297573 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.297787 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.297883 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.298105 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.298192 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.298409 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.298494 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.298710 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.298802 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.299024 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.299118 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.299324 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.299409 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.299627 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.299713 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.299936 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.300032 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.300244 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.300331 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.300552 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.300645 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.300860 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.300960 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.301195 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.301282 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.301515 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.302120 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.302367 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.302455 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.302679 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.302777 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.303007 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.303095 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.303333 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.303420 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.303635 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.303721 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.303944 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.304030 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.304261 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.304353 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.304570 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.304655 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.304869 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.304954 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.305202 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.305292 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.305505 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.305594 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.305807 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.305903 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.306108 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.306203 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.306412 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.306496 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.306707 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.306800 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.307006 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.307100 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.307304 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.307398 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.307602 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.307698 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.307904 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.307991 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.308206 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.308298 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.308510 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.308605 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.308807 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.308899 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.309127 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.309216 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.309427 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.309522 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.309762 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.309850 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.310060 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.310154 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.310396 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.310484 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.310722 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.310809 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.311036 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.311130 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.311347 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.311433 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.311655 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.311747 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.311965 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.312050 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.312268 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.312354 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.312575 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.312677 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.312884 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.313025 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.313212 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.313301 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.313524 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.313617 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.313829 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.313927 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.314142 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.314229 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.314447 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.314540 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.314751 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.314846 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.315061 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.315146 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.315378 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.315512 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.315679 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.315775 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.315989 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.316077 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.316323 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.316447 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.316636 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.316738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.316949 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.317047 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.317826 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.317920 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.318154 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.318243 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.318469 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.318555 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.318782 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.318876 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.319091 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.319188 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.319400 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.319489 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.319706 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.319793 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.320017 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.320104 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.320321 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.320417 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.320636 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.320723 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.320941 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.321097 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.321271 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.321357 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.321583 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.321670 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.321897 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.321986 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.322196 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.322291 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.322522 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.322623 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.322829 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.322973 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.323150 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.323243 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.323455 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.323549 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.323763 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.323849 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.324075 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.324164 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.324381 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.324474 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.324686 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.324772 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.325030 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.325132 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.325315 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.325411 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.325617 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.325704 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.325924 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.326010 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.326231 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.326317 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.326535 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.326628 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.326842 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.326928 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.327143 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.327237 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.327446 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.327537 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.327749 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.327841 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.328055 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.328143 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.328355 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.328444 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.328662 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.328749 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.328992 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.329081 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.329307 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.329403 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.329611 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.329706 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.329927 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.330013 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.330228 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.330323 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.330529 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.330625 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.330834 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.330920 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.331138 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.331223 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.331438 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.331538 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.331738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.331826 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.332038 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.332125 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.332375 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.332468 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.332681 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.332768 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.333028 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.333131 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.333348 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.333443 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.333666 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.333752 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.333971 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.334066 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.334283 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.334371 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.334592 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.334687 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.334901 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.334988 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.335218 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.335309 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.335528 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.335614 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.335835 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.335922 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.336145 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.336233 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.336453 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.336541 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.336762 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.336862 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.337099 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.337187 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.337417 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.337503 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.337722 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.337824 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.338033 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.338125 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.338339 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.338425 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.338642 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.338914 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.339002 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.339251 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.339338 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.339572 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.339809 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.339905 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.340140 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.340235 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.340452 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.340547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.340769 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.340855 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.341146 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.341253 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.341466 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.341554 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.341796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.341884 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.342109 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.342206 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.342419 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.342505 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.342720 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.342805 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.343031 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.343164 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.343336 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.343423 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.343639 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.343734 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.343944 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.344030 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.344245 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.344337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.344548 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.344634 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.344849 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.344938 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.345180 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.345269 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.345484 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.345571 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.345786 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.345882 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.346088 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.346175 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.346391 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.346478 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.346748 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.346847 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.346995 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.347081 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.347305 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.347392 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.347607 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.347702 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.347912 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.347998 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.348222 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.348319 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.348549 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.348635 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.348851 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.348945 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.349174 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.349279 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.349513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.349601 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.349815 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.349915 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.350148 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.350248 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.350471 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.350566 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.350795 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.350880 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.351097 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.351183 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.351398 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.351494 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.351703 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.351800 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.352008 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.352094 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.352312 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.352398 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.352610 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.352697 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.352916 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.353035 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.353244 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.353343 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.353543 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.353632 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.353851 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.353948 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.354155 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.354240 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.354460 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.354554 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.354765 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.354850 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.355062 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.355147 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.355368 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.355512 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.355668 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.355756 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.355971 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.356057 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.356275 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.356374 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.356576 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.356664 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.356877 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.357036 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.357206 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.357312 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.357511 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.357604 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.357812 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.357910 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.358117 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.358206 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.358417 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.358504 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.358720 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.358806 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.359018 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.359105 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.359319 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.359406 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.359618 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.359705 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.359921 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.360010 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.360224 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.360312 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.360523 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.360610 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.360824 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.360912 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.361158 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.361246 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.361460 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.361557 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.361760 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.362120 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.362328 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.362456 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.362628 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.362725 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.362928 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.363017 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.363234 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.363321 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.363548 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.363641 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.363855 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.363942 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.364673 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.364772 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.365038 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.365142 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.365306 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.365391 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.365607 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.365693 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.365908 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.365995 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.366212 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.366343 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.366508 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.366600 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.366806 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.366915 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.367107 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.367219 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.367405 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.367500 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.367704 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.367792 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.368010 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.368096 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.368318 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.368404 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.368617 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.368703 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.368917 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.369032 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.369241 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.369339 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.369579 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.369667 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.369880 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.369966 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.370223 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.370317 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.370524 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.370610 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.370835 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.370921 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.371150 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.371243 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.371457 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.371544 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.371765 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.371850 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.372075 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.372179 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.372376 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.372463 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.372679 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.372764 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.372996 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.373096 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.373313 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.373408 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.373613 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.373704 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.373914 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.374003 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.374232 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.374319 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.374542 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.374631 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.374850 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.374938 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.375156 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.375248 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.375468 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.375556 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.375787 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.375875 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.376083 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.376214 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.376389 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.376483 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.376698 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.376785 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.377021 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.377250 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.377342 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.377435 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.377620 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.377708 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.377927 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.378013 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.378235 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.378328 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.378541 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.378639 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.378846 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.378932 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.379153 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.379256 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.379453 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.379547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.380313 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.380406 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.380636 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.380732 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.380938 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.381073 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.381274 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.381360 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.381578 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.381671 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.381879 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.381975 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.382183 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.382268 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.382481 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.382610 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.382791 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.382925 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.383092 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.383237 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.383514 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.383640 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.383825 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.383912 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.384134 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.384224 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.384436 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.384524 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.384744 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.384830 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.385067 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.385174 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.385383 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.385469 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.385691 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.385777 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.385992 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.386092 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.386408 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.386502 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.386697 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.386783 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.387001 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.387095 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.387308 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.387398 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.387611 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.387699 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.387909 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.388005 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.388215 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.388300 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.388520 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.388606 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.388823 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.388909 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.389152 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.389280 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.389451 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.389559 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.389770 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.389858 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.390071 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.390157 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.390386 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.390473 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.390793 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.390888 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.391098 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.391184 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.391399 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.391484 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.391756 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.391842 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.392079 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.392176 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.392386 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.392479 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.392699 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.392784 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.393032 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.393124 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.393349 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.393446 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.393650 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.393790 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.393959 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.394054 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.394264 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.394351 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.394582 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.394678 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.394884 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.394977 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.395194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.395280 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.395532 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.395632 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.395834 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.395922 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.396153 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.396240 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.396471 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.396614 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.396781 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.396869 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.397122 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.397215 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.397521 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.397620 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.397839 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.397926 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.398145 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.398231 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.398454 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.398551 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.398768 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.398855 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.399068 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.399154 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.399369 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.399462 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.399677 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.399772 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.399979 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.400066 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.400280 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.400375 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.400590 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.400675 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.400887 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.401012 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.401219 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.401391 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.401525 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.401619 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.401825 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.401920 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.402124 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.402211 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.402424 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.402510 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.402741 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.402838 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.403039 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.403127 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.403356 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.403444 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.403662 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.403756 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.403975 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.404064 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.404286 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.404371 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.404585 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.404671 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.404886 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.405024 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.405217 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.405304 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.405520 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.405609 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.405819 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.405915 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.406119 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.406206 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.406457 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.406558 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.406759 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.406846 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.407076 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.407170 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.407401 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.407504 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.407726 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.407826 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.408030 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.408128 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.408347 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.408439 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.408667 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.408754 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.408992 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.409094 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.409312 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.409400 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.409618 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.409711 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.409932 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.410028 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.410234 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.410320 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.410535 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.410621 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.410840 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.410935 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.411658 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.411745 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.411963 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.412051 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.412267 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.412356 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.412572 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.412664 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.412870 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.412955 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.413200 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.413298 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.413502 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.413590 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.413821 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.413908 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.414123 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.414212 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.414429 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.414515 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.414735 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.414829 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.415038 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.415127 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.415340 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.415428 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.415640 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.415740 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.415979 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.416066 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.416280 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.416367 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.416605 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.416702 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.416912 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.417081 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.417256 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.417342 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.417572 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.417671 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.417885 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.417983 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.418199 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.418287 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.418513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.418613 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.418823 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.418927 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.419133 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.419228 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.419445 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.419534 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.419754 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.419842 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.420069 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.420276 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.420372 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.420611 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.420742 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.420929 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.421212 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.421302 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.421538 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.421627 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.421851 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.421938 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.422161 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.422262 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.422470 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.422558 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.422783 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.422869 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.423090 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.423183 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.423397 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.423486 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.423704 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.423792 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.424013 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.424110 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.424319 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.424407 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.424643 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.424730 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.424958 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.425073 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.425299 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.425386 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.425614 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.425709 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.425922 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.426010 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.426236 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.426323 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.426544 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.426709 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.427401 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.427490 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.427726 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.427811 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.428045 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.428146 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.428345 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.428432 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.428656 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.428744 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.429009 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.429112 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.429301 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.429389 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.429611 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.429699 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.429921 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.430009 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.430231 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.430318 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.430541 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.430629 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.430852 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.430948 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.431160 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.431250 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.431468 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.431563 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.431778 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.431867 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.432096 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.432192 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.432410 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.432504 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.432726 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.432814 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.433061 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.433280 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.433369 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.433599 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.433688 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.433937 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.434171 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.434267 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.434482 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.434580 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.434810 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.434905 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.435131 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.435219 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.435450 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.435550 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.435761 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.435849 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.436075 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.436162 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.436396 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.436493 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.436700 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.436789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.437024 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.437114 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.437337 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.437425 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.437644 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.437787 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.437945 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.438078 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.438262 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.438352 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.438570 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.438665 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.438874 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.439104 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.439200 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.439454 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.439543 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.439775 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.439990 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.440086 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.440334 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.440428 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.440649 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.440746 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.440982 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.441084 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.441315 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.441409 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.441631 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.441718 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.441933 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.442029 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.442272 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.442361 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.442574 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.442661 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.442877 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.442972 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.443183 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.443277 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.443489 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.443582 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.443790 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.443880 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.444090 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.444184 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.444396 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.444490 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.444700 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.444800 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.445016 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.445106 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.445324 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.445413 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.445623 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.445712 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.445942 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.446027 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.446241 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.446340 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.446542 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.446630 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.446844 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.446933 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.447150 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.447244 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.447448 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.447534 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.447747 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.447881 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.448047 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.448187 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.448346 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.448447 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.448648 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.448735 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.448951 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.449112 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.449275 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.449364 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.449574 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.449661 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.449879 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.449975 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.450222 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.450310 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.450528 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.450620 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.450824 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.450911 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.451140 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.451238 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.451439 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.451526 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.451740 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.451829 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.452050 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.452138 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.452360 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.452447 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.452679 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.452768 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.453019 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.453113 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.453320 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.453562 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.453664 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.453905 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.453992 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.454232 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.454477 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.454579 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.454808 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.454896 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.455125 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.455212 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.455455 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.455556 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.455783 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.455871 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.456086 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.456173 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.456387 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.456483 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.456688 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.456784 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.457034 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.457126 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.457347 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.457437 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.457657 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.457743 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.457986 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.458082 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.458296 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.458386 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.458603 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.458692 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.458912 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.459005 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.459217 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.459304 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.459523 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.459611 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.459831 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.459926 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.460134 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.460221 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.460440 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.460529 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.460746 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.460847 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.461079 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.461229 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.461389 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.461479 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.461700 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.461806 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.462031 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.462117 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.462351 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.462439 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.462664 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.462755 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.462972 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.463058 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.463280 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.463366 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.463584 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.463671 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.463890 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.463979 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.464195 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.464283 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.464500 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.464589 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.464810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.464897 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.465158 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.465470 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.465558 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.465773 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.465861 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.466115 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.466422 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.466518 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.466738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.466826 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.467055 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.467143 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.467376 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.467474 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.467684 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.467772 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.468003 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.468138 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.468313 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.468407 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.468620 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.468707 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.468942 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.469060 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.469273 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.469362 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.469598 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.469685 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.469921 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.470014 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.470229 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.470324 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.470535 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.470622 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.470841 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.470927 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.471143 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.471232 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.471443 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.471530 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.471748 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.471841 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.472055 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.472143 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.472357 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.472443 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.472657 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.472816 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.472956 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.473101 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.473283 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.473381 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.474120 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.474221 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.474425 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.474513 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.474726 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.474810 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.475023 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.475118 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.475326 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.475411 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.475620 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.475713 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.475919 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.476008 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.476217 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.476306 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.476515 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.476603 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.476815 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.476903 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.477142 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.477241 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.477447 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.477535 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.477753 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.477842 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.478057 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.478190 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.478353 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.478447 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.478651 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.478740 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.478948 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.479035 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.479275 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.479371 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.479604 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.479693 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.479963 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.480056 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.480222 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.480318 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.480524 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.480610 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.480839 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.480936 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.481169 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.481270 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.481478 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.481564 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.481791 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.481877 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.482101 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.482197 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.482404 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.482492 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.482715 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.482800 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.483021 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.483108 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.483329 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.483414 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.483634 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.483728 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.483940 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.484030 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.484243 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.484330 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.484548 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.484636 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.484869 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.484957 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.485214 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.485301 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.485515 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.485609 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.485836 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.485924 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.486146 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.486231 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.486460 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.486558 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.486770 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.487117 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.487342 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.487429 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.487652 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.487747 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.487962 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.488055 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.488268 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.488356 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.488574 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.488669 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.488879 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.488994 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.489764 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.489865 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.490077 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.490164 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.490387 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.490481 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.490695 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.490783 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.491010 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.491099 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.491322 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.491408 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.491644 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.491742 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.491964 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.492053 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.492269 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.492356 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.492589 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.492688 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.492910 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.493024 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.493273 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.493361 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.493585 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.493682 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.493898 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.493984 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.494206 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.494295 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.494448 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 20 22:15:17.494544 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.494823 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.495124 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:15:17.495362 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 20 22:15:17.646933 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO dbcounter [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] Registered counter for database nova_api Sep 20 22:15:17.647256 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO dbcounter [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] Registered counter for database nova_api Sep 20 22:15:17.668924 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_db.sqlalchemy.engines [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 22:15:17.670709 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG oslo_db.sqlalchemy.engines [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 22:15:17.675529 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writer thread running {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 22:15:17.677638 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writer thread running {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 22:15:17.731809 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.context [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aaca181d-8f33-4223-a648-2988e81860b3(cell1) {{(pid=105476) load_cells /opt/stack/nova/nova/context.py:464}} Sep 20 22:15:17.732403 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.context [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aaca181d-8f33-4223-a648-2988e81860b3(cell1) {{(pid=105477) load_cells /opt/stack/nova/nova/context.py:464}} Sep 20 22:15:17.735675 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:15:17.736147 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:15:17.736251 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:15:17.736712 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:15:17.737996 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:15:17.738542 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:15:17.738721 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:15:17.739793 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:15:17.739982 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:15:17.740344 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:15:17.742363 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:15:17.743520 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:15:17.744549 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO dbcounter [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] Registered counter for database nova_cell0 Sep 20 22:15:17.746157 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO dbcounter [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] Registered counter for database nova_cell0 Sep 20 22:15:17.749673 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO dbcounter [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] Registered counter for database nova_cell1 Sep 20 22:15:17.750379 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO dbcounter [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] Registered counter for database nova_cell1 Sep 20 22:15:17.757539 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG oslo_db.sqlalchemy.engines [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 22:15:17.759276 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_db.sqlalchemy.engines [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 22:15:17.760509 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_db.sqlalchemy.engines [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 22:15:17.762137 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG oslo_db.sqlalchemy.engines [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 22:15:17.765487 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writer thread running {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 22:15:17.767145 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writer thread running {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 22:15:17.904063 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writer thread running {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 22:15:17.905896 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writer thread running {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 22:15:17.913844 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO dbcounter [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] Registered counter for database nova_cell0 Sep 20 22:15:17.914359 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO dbcounter [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] Registered counter for database nova_cell0 Sep 20 22:15:17.922595 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG oslo_db.sqlalchemy.engines [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 22:15:17.926151 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_db.sqlalchemy.engines [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 22:15:17.927903 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writer thread running {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 22:15:17.931423 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writer thread running {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 22:15:18.264549 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: WARNING keystonemiddleware.auth_token [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 20 22:15:18.268530 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: WARNING keystonemiddleware.auth_token [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 20 22:15:18.271871 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: WARNING keystonemiddleware.auth_token [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 20 22:15:18.275752 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: WARNING keystonemiddleware.auth_token [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 20 22:15:18.615251 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: WARNING keystonemiddleware.auth_token [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 20 22:15:18.621082 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: WARNING keystonemiddleware.auth_token [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 20 22:15:18.624675 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: WARNING keystonemiddleware.auth_token [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 20 22:15:18.626328 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557a9a2fe9c0 pid: 105476 (default app) Sep 20 22:15:18.628439 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:15:18.629641 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001808 Sep 20 22:15:18.630066 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Tue Sep 20 22:15:18 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:15:18.630681 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: WARNING keystonemiddleware.auth_token [None req-7669b70c-3ea0-46fc-8d3c-fcce12598779 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 20 22:15:18.636352 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557a9a2fe9c0 pid: 105477 (default app) Sep 20 22:16:40.144045 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:16:40.145083 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 20 22:16:40.145488 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 20 22:16:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:16:40.157423 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_api:SELECT=3 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:40.158376 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_cell1:SELECT=3 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:40.160029 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_cell0:SELECT=3 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:40.160936 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:41.166282 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-659a36d8-bdb6-40b2-bc2f-6fc4bcb148d8 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:16:41.199490 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-659a36d8-bdb6-40b2-bc2f-6fc4bcb148d8 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.047123 Sep 20 22:16:41.200142 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Tue Sep 20 22:16:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:16:43.879674 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:16:43.880668 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-41f818f4-a543-45c0-be8c-017b625aac41 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Sep 20 22:16:43.881386 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 20 22:16:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:16:44.297207 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-2393eafd-ae74-4828-9b1c-72761ca315e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "name": "cirros256", "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:16:44.343761 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-2393eafd-ae74-4828-9b1c-72761ca315e0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.456612 Sep 20 22:16:44.344340 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 20 22:16:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 20 22:16:44.358169 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_api:SELECT=3 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:44.360225 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_cell0:SELECT=3 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:44.363297 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_cell1:SELECT=3 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:44.364383 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:44.566732 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-6b35eb01-8dde-4f23-8a5c-c363fbdcc21e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:16:44.638877 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-6b35eb01-8dde-4f23-8a5c-c363fbdcc21e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285745 Sep 20 22:16:44.639470 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Tue Sep 20 22:16:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:16:47.283199 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-2393eafd-ae74-4828-9b1c-72761ca315e0 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:16:47.284779 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-2393eafd-ae74-4828-9b1c-72761ca315e0 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002029 Sep 20 22:16:47.285435 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 20 22:16:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:16:47.949068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-f2d3bf88-65ef-4883-beab-247dd9ff9468 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d1", "rxtx_factor": 1.0}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:16:47.992531 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-f2d3bf88-65ef-4883-beab-247dd9ff9468 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.701061 Sep 20 22:16:47.993691 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 20 22:16:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:16:48.006204 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-b186c19a-6e93-4918-bee2-43a13f4f580e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:16:48.057663 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-b186c19a-6e93-4918-bee2-43a13f4f580e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055278 Sep 20 22:16:48.058405 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Tue Sep 20 22:16:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:16:50.679960 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-f2d3bf88-65ef-4883-beab-247dd9ff9468 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:16:50.680996 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-f2d3bf88-65ef-4883-beab-247dd9ff9468 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 20 22:16:50.681445 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 20 22:16:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:16:51.110494 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-f1a6dd91-1f3c-42fe-8576-5e4779a93dcb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G", "ram": 1024, "id": "d2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:16:51.131843 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-f1a6dd91-1f3c-42fe-8576-5e4779a93dcb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444395 Sep 20 22:16:51.132395 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 20 22:16:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:16:51.144887 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-72f80a56-ace5-4512-bd2c-4af626f1aa17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:16:51.172436 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-72f80a56-ace5-4512-bd2c-4af626f1aa17 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031721 Sep 20 22:16:51.173222 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Tue Sep 20 22:16:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:16:53.838395 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-f1a6dd91-1f3c-42fe-8576-5e4779a93dcb admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:16:53.839420 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-f1a6dd91-1f3c-42fe-8576-5e4779a93dcb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 20 22:16:53.839824 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 20 22:16:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:16:54.271306 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-70700018-68f5-45e1-a5ba-d19b0c298d74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "id": "d3", "disk": 10, "rxtx_factor": 1.0}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:16:54.292177 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-70700018-68f5-45e1-a5ba-d19b0c298d74 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446172 Sep 20 22:16:54.293153 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 20 22:16:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:16:54.305123 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-88831508-1ecc-4ae1-8848-9f29e12c62f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:16:54.334604 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-88831508-1ecc-4ae1-8848-9f29e12c62f0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033098 Sep 20 22:16:54.335247 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Tue Sep 20 22:16:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:16:56.936367 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-70700018-68f5-45e1-a5ba-d19b0c298d74 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:16:56.937406 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-70700018-68f5-45e1-a5ba-d19b0c298d74 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 20 22:16:56.937800 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 20 22:16:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:16:57.340261 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-14180810-98db-4023-b108-21e412d0447d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "disk": 20}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:16:57.359067 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-14180810-98db-4023-b108-21e412d0447d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.415186 Sep 20 22:16:57.359615 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 20 22:16:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 20 22:16:57.372651 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-ca8d43cd-e17f-4647-ab6c-b4e477a1bda5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:16:57.397502 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-ca8d43cd-e17f-4647-ab6c-b4e477a1bda5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028495 Sep 20 22:16:57.398098 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Tue Sep 20 22:16:57 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:16:59.963901 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-14180810-98db-4023-b108-21e412d0447d admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:16:59.964922 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-14180810-98db-4023-b108-21e412d0447d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 20 22:16:59.965356 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 20 22:16:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:17:00.425211 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-8daf6ef5-1c9c-4b57-8829-36078ac2d728 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:00.450239 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-8daf6ef5-1c9c-4b57-8829-36078ac2d728 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.478923 Sep 20 22:17:00.450793 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Tue Sep 20 22:16:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:17:03.037986 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-14180810-98db-4023-b108-21e412d0447d admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:03.039002 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-14180810-98db-4023-b108-21e412d0447d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 20 22:17:03.039405 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 20 22:17:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:17:03.448732 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-296438ed-ac16-496f-8ec1-8b413fd1224f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:17:03.469430 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-296438ed-ac16-496f-8ec1-8b413fd1224f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.423691 Sep 20 22:17:03.469965 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 20 22:17:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:17:03.482569 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-edb09e0c-167a-4dad-9f7f-f09961a61edb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:17:03.512055 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-edb09e0c-167a-4dad-9f7f-f09961a61edb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032484 Sep 20 22:17:03.512667 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Tue Sep 20 22:17:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:17:06.104586 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-296438ed-ac16-496f-8ec1-8b413fd1224f admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:06.106220 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-296438ed-ac16-496f-8ec1-8b413fd1224f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002174 Sep 20 22:17:06.106641 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 20 22:17:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:17:06.505321 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-2bc5db5e-1ec4-4846-9983-85c73fcbfb0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:17:06.524835 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-2bc5db5e-1ec4-4846-9983-85c73fcbfb0c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.411447 Sep 20 22:17:06.525406 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 20 22:17:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:17:06.538339 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-a6341ebe-fe51-4af5-8d62-c12a92f588e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:17:06.561551 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-a6341ebe-fe51-4af5-8d62-c12a92f588e6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026914 Sep 20 22:17:06.562113 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Tue Sep 20 22:17:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:17:09.197416 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-2bc5db5e-1ec4-4846-9983-85c73fcbfb0c admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:09.198420 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-2bc5db5e-1ec4-4846-9983-85c73fcbfb0c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 20 22:17:09.198817 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 20 22:17:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:17:09.645026 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-9197a712-ffcb-4a2a-9cf1-55b33176a712 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium", "swap": 0, "disk": 40, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:17:09.666349 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-9197a712-ffcb-4a2a-9cf1-55b33176a712 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.461454 Sep 20 22:17:09.667242 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 20 22:17:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:17:09.680050 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-1f0bea7f-0a63-487c-a8da-d6ce2cd58c8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:17:09.707598 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-1f0bea7f-0a63-487c-a8da-d6ce2cd58c8b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031221 Sep 20 22:17:09.708518 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Tue Sep 20 22:17:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:17:12.335472 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-9197a712-ffcb-4a2a-9cf1-55b33176a712 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:12.336475 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-9197a712-ffcb-4a2a-9cf1-55b33176a712 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 20 22:17:12.336874 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 20 22:17:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:17:12.834777 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-f00c9346-cc03-4cb6-b2d6-bf8a80478e3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "name": "m1.large"}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:17:12.840412 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:12.858417 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-f00c9346-cc03-4cb6-b2d6-bf8a80478e3d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.513760 Sep 20 22:17:12.859301 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 20 22:17:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:17:12.873310 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-f458a830-70ab-4949-b249-a1f3a14701ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:17:12.902986 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-f458a830-70ab-4949-b249-a1f3a14701ca admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035354 Sep 20 22:17:12.909008 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Tue Sep 20 22:17:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:17:15.506579 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-f00c9346-cc03-4cb6-b2d6-bf8a80478e3d admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:15.507505 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-f00c9346-cc03-4cb6-b2d6-bf8a80478e3d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 20 22:17:15.507908 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 20 22:17:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:17:15.958637 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-5209a151-54ec-4f8f-8299-5228650e4d9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:17:15.967670 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:15.981215 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-5209a151-54ec-4f8f-8299-5228650e4d9f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.466434 Sep 20 22:17:15.981989 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 20 22:17:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:17:15.995518 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-0a8440ad-23f6-4400-8e20-8ef4d98dbed0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:17:16.023451 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-0a8440ad-23f6-4400-8e20-8ef4d98dbed0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032497 Sep 20 22:17:16.024458 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Tue Sep 20 22:17:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:17:35.023657 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-5209a151-54ec-4f8f-8299-5228650e4d9f admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:35.024681 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-5209a151-54ec-4f8f-8299-5228650e4d9f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 20 22:17:35.025108 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 20 22:17:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:17:35.035634 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:35.415264 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-8fccc982-0019-4c79-bd8e-0360c8dfc9ee admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:35.433476 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-8fccc982-0019-4c79-bd8e-0360c8dfc9ee admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402247 Sep 20 22:17:35.433944 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Tue Sep 20 22:17:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:17:36.730336 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-5209a151-54ec-4f8f-8299-5228650e4d9f admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:36.731335 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-5209a151-54ec-4f8f-8299-5228650e4d9f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Sep 20 22:17:36.731729 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 20 22:17:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:17:37.247602 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7d2ddec7-87e1-4533-b58a-2a5e127539c0 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:37.253839 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.wsgi [None req-7d2ddec7-87e1-4533-b58a-2a5e127539c0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7d2ddec7-87e1-4533-b58a-2a5e127539c0 admin admin] Request method failure captured: Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Accept: application/json Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Accept-Encoding: gzip, deflate Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Connection: keep-alive Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Content-Length: 0 Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Host: 10.222.0.16 Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Openstack-Api-Version: compute 2.92 Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Openstack-System-Scope: None Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: User-Agent: python-novaclient Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Auth-Token: gAAAAABjKjwAsKj4H0_LYoVT_zYMYH2ukA4QfOXKibOQDEdA7AoorYHbtHPb9HzsM9yDVbIgmgobOw_EaY6vPQKAUL6-sL0h2DFw8KE5_HZXp12A-pzPlMJgd1oLFuBGtK-JwwUQDQXfLIIS9WnGGUH4_aCv1C2CsHImlv1c41TwgEDSlhqqokY Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Domain-Id: None Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Domain-Name: None Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Identity-Status: Confirmed Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Is-Admin-Project: True Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Openstack-Nova-Api-Version: 2.92 Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Project-Domain-Id: default Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Project-Domain-Name: Default Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Project-Id: c43595da141a4fa38e7ea2e26db5eba9 Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Project-Name: admin Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Role: reader,member,admin Sep 20 22:17:37.257194 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Roles: reader,member,admin Sep 20 22:17:37.258607 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c43595da141a4fa38e7ea2e26db5eba9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c43595da141a4fa38e7ea2e26db5eba9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c43595da141a4fa38e7ea2e26db5eba9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c43595da141a4fa38e7ea2e26db5eba9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:17:37.258607 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Tenant: admin Sep 20 22:17:37.258607 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Tenant-Id: c43595da141a4fa38e7ea2e26db5eba9 Sep 20 22:17:37.258607 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Tenant-Name: admin Sep 20 22:17:37.258607 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-User: admin Sep 20 22:17:37.258607 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-User-Domain-Id: default Sep 20 22:17:37.258607 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-User-Domain-Name: Default Sep 20 22:17:37.258607 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-User-Id: 5610cc76f5f445f4ab3b97181fd1e7ed Sep 20 22:17:37.258607 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-User-Name: admin Sep 20 22:17:37.258607 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: method: > Sep 20 22:17:37.258607 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: exception: Flavor 42 could not be found. Sep 20 22:17:37.258607 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: action_args: {'id': '42'} Sep 20 22:17:37.258607 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:17:37.258607 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:17:37.259513 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:17:37.260645 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:17:37.260645 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:17:37.260645 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:17:37.260645 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:17:37.260645 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 20 22:17:37.260645 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:17:37.260645 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 20 22:17:37.260645 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 20 22:17:37.260645 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:17:37.260645 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 20 22:17:37.260645 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:17:37.260645 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:17:37.260645 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:17:37.260645 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:17:37.260645 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:17:37.260645 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 20 22:17:37.260645 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 20 22:17:37.260645 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7d2ddec7-87e1-4533-b58a-2a5e127539c0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:17:37.261866 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-7d2ddec7-87e1-4533-b58a-2a5e127539c0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389823 Sep 20 22:17:37.261866 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Sep 20 22:17:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:37.269351 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-b00ca2e5-6943-459d-a326-0a3db55e54b9 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:37.292230 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-b00ca2e5-6943-459d-a326-0a3db55e54b9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026817 Sep 20 22:17:37.292779 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Sep 20 22:17:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:17:37.304041 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-291bba00-4a45-4904-a4e3-6a4e6f693824 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:37.326677 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-291bba00-4a45-4904-a4e3-6a4e6f693824 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027159 Sep 20 22:17:37.327212 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Sep 20 22:17:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:17:37.336377 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-2e839ff8-e65e-4abc-ae92-cb181d6c785c admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:37.342262 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.wsgi [None req-2e839ff8-e65e-4abc-ae92-cb181d6c785c admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-2e839ff8-e65e-4abc-ae92-cb181d6c785c admin admin] Request method failure captured: Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Accept: application/json Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Accept-Encoding: gzip, deflate Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Connection: keep-alive Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Content-Length: 0 Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Host: 10.222.0.16 Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Openstack-Api-Version: compute 2.92 Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Openstack-System-Scope: None Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: User-Agent: python-novaclient Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Auth-Token: gAAAAABjKjwAsKj4H0_LYoVT_zYMYH2ukA4QfOXKibOQDEdA7AoorYHbtHPb9HzsM9yDVbIgmgobOw_EaY6vPQKAUL6-sL0h2DFw8KE5_HZXp12A-pzPlMJgd1oLFuBGtK-JwwUQDQXfLIIS9WnGGUH4_aCv1C2CsHImlv1c41TwgEDSlhqqokY Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Domain-Id: None Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Domain-Name: None Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Identity-Status: Confirmed Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Is-Admin-Project: True Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Openstack-Nova-Api-Version: 2.92 Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Project-Domain-Id: default Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Project-Domain-Name: Default Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Project-Id: c43595da141a4fa38e7ea2e26db5eba9 Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Project-Name: admin Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Role: reader,member,admin Sep 20 22:17:37.345789 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Roles: reader,member,admin Sep 20 22:17:37.347359 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c43595da141a4fa38e7ea2e26db5eba9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c43595da141a4fa38e7ea2e26db5eba9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c43595da141a4fa38e7ea2e26db5eba9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c43595da141a4fa38e7ea2e26db5eba9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:17:37.347359 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Tenant: admin Sep 20 22:17:37.347359 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Tenant-Id: c43595da141a4fa38e7ea2e26db5eba9 Sep 20 22:17:37.347359 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Tenant-Name: admin Sep 20 22:17:37.347359 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-User: admin Sep 20 22:17:37.347359 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-User-Domain-Id: default Sep 20 22:17:37.347359 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-User-Domain-Name: Default Sep 20 22:17:37.347359 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-User-Id: 5610cc76f5f445f4ab3b97181fd1e7ed Sep 20 22:17:37.347359 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-User-Name: admin Sep 20 22:17:37.347359 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: method: > Sep 20 22:17:37.347359 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: exception: Flavor 42 could not be found. Sep 20 22:17:37.347359 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: action_args: {'id': '42'} Sep 20 22:17:37.347359 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:17:37.347359 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:17:37.348337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:17:37.349810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:17:37.349810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:17:37.349810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:17:37.349810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:17:37.349810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 20 22:17:37.349810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:17:37.349810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 20 22:17:37.349810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Sep 20 22:17:37.349810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:17:37.349810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Sep 20 22:17:37.349810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:17:37.349810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:17:37.349810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:17:37.349810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:17:37.349810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:17:37.349810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 20 22:17:37.349810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Sep 20 22:17:37.349810 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-2e839ff8-e65e-4abc-ae92-cb181d6c785c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:17:37.351088 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-2e839ff8-e65e-4abc-ae92-cb181d6c785c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014338 Sep 20 22:17:37.351088 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Sep 20 22:17:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:38.579767 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-291bba00-4a45-4904-a4e3-6a4e6f693824 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:38.580773 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-291bba00-4a45-4904-a4e3-6a4e6f693824 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002099 Sep 20 22:17:38.581188 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 20 22:17:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:17:39.101228 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-48b0003c-00c6-4069-bc4f-7689a8c64358 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:39.106236 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.wsgi [None req-48b0003c-00c6-4069-bc4f-7689a8c64358 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-48b0003c-00c6-4069-bc4f-7689a8c64358 admin admin] Request method failure captured: Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Accept: application/json Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Accept-Encoding: gzip, deflate Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Connection: keep-alive Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Content-Length: 0 Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Host: 10.222.0.16 Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Openstack-Api-Version: compute 2.92 Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Openstack-System-Scope: None Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: User-Agent: python-novaclient Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Auth-Token: gAAAAABjKjwCXt3ggAZ8OyuCjfNxoP-aR605YKtEq9JIex0kPxR67kRQA0BGmvpTpHym0o8X0aMAC2HYsBQ1In3mhKCW9oovvdjphJokVOUsIUO8NZU1Qs4mHEcPr0KAcRxRjOGHXP77wQSbrNFqEsOzeHoZFg1ehEoGAA1QFeAYXarwTJvy8IU Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Domain-Id: None Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Domain-Name: None Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Identity-Status: Confirmed Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Is-Admin-Project: True Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Openstack-Nova-Api-Version: 2.92 Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Project-Domain-Id: default Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Project-Domain-Name: Default Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Project-Id: c43595da141a4fa38e7ea2e26db5eba9 Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Project-Name: admin Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Role: reader,member,admin Sep 20 22:17:39.107733 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Roles: reader,member,admin Sep 20 22:17:39.109230 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c43595da141a4fa38e7ea2e26db5eba9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c43595da141a4fa38e7ea2e26db5eba9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c43595da141a4fa38e7ea2e26db5eba9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c43595da141a4fa38e7ea2e26db5eba9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:17:39.109230 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Tenant: admin Sep 20 22:17:39.109230 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Tenant-Id: c43595da141a4fa38e7ea2e26db5eba9 Sep 20 22:17:39.109230 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Tenant-Name: admin Sep 20 22:17:39.109230 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-User: admin Sep 20 22:17:39.109230 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-User-Domain-Id: default Sep 20 22:17:39.109230 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-User-Domain-Name: Default Sep 20 22:17:39.109230 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-User-Id: 5610cc76f5f445f4ab3b97181fd1e7ed Sep 20 22:17:39.109230 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-User-Name: admin Sep 20 22:17:39.109230 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: method: > Sep 20 22:17:39.109230 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: exception: Flavor 84 could not be found. Sep 20 22:17:39.109230 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: action_args: {'id': '84'} Sep 20 22:17:39.109230 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:17:39.109230 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:17:39.110689 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:17:39.112144 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:17:39.112144 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:17:39.112144 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:17:39.112144 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:17:39.112144 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 20 22:17:39.112144 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:17:39.112144 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 20 22:17:39.112144 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Sep 20 22:17:39.112144 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:17:39.112144 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Sep 20 22:17:39.112144 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:17:39.112144 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:17:39.112144 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:17:39.112144 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:17:39.112144 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:17:39.112144 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 20 22:17:39.112144 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Sep 20 22:17:39.112144 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-48b0003c-00c6-4069-bc4f-7689a8c64358 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:17:39.113634 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-48b0003c-00c6-4069-bc4f-7689a8c64358 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.390351 Sep 20 22:17:39.113634 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Sep 20 22:17:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:39.119765 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-98818813-885b-4514-b3fb-4676892efd45 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:39.135003 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-98818813-885b-4514-b3fb-4676892efd45 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018804 Sep 20 22:17:39.135518 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Sep 20 22:17:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:17:39.144601 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-22565a42-6b1a-4bae-a2e8-6945bf264edc admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:39.160102 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-22565a42-6b1a-4bae-a2e8-6945bf264edc admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018971 Sep 20 22:17:39.160614 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Sep 20 22:17:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:17:39.169476 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7ff34374-b732-42f2-9ebf-bb7eb6af93ed admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:39.174865 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.wsgi [None req-7ff34374-b732-42f2-9ebf-bb7eb6af93ed admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7ff34374-b732-42f2-9ebf-bb7eb6af93ed admin admin] Request method failure captured: Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Accept: application/json Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Accept-Encoding: gzip, deflate Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Connection: keep-alive Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Content-Length: 0 Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Host: 10.222.0.16 Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Openstack-Api-Version: compute 2.92 Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Openstack-System-Scope: None Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: User-Agent: python-novaclient Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Auth-Token: gAAAAABjKjwCXt3ggAZ8OyuCjfNxoP-aR605YKtEq9JIex0kPxR67kRQA0BGmvpTpHym0o8X0aMAC2HYsBQ1In3mhKCW9oovvdjphJokVOUsIUO8NZU1Qs4mHEcPr0KAcRxRjOGHXP77wQSbrNFqEsOzeHoZFg1ehEoGAA1QFeAYXarwTJvy8IU Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Domain-Id: None Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Domain-Name: None Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Identity-Status: Confirmed Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Is-Admin-Project: True Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Openstack-Nova-Api-Version: 2.92 Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Project-Domain-Id: default Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Project-Domain-Name: Default Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Project-Id: c43595da141a4fa38e7ea2e26db5eba9 Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Project-Name: admin Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Role: reader,member,admin Sep 20 22:17:39.176359 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Roles: reader,member,admin Sep 20 22:17:39.177947 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c43595da141a4fa38e7ea2e26db5eba9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c43595da141a4fa38e7ea2e26db5eba9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c43595da141a4fa38e7ea2e26db5eba9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c43595da141a4fa38e7ea2e26db5eba9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:17:39.177947 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Tenant: admin Sep 20 22:17:39.177947 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Tenant-Id: c43595da141a4fa38e7ea2e26db5eba9 Sep 20 22:17:39.177947 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Tenant-Name: admin Sep 20 22:17:39.177947 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-User: admin Sep 20 22:17:39.177947 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-User-Domain-Id: default Sep 20 22:17:39.177947 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-User-Domain-Name: Default Sep 20 22:17:39.177947 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-User-Id: 5610cc76f5f445f4ab3b97181fd1e7ed Sep 20 22:17:39.177947 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-User-Name: admin Sep 20 22:17:39.177947 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: method: > Sep 20 22:17:39.177947 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: exception: Flavor 84 could not be found. Sep 20 22:17:39.177947 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: action_args: {'id': '84'} Sep 20 22:17:39.177947 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:17:39.177947 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:17:39.178796 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:17:39.180132 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:17:39.180132 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:17:39.180132 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:17:39.180132 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:17:39.180132 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 20 22:17:39.180132 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:17:39.180132 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 20 22:17:39.180132 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 20 22:17:39.180132 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:17:39.180132 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 20 22:17:39.180132 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:17:39.180132 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:17:39.180132 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:17:39.180132 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:17:39.180132 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:17:39.180132 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 20 22:17:39.180132 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 20 22:17:39.180132 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7ff34374-b732-42f2-9ebf-bb7eb6af93ed admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:17:39.181345 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-7ff34374-b732-42f2-9ebf-bb7eb6af93ed admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011669 Sep 20 22:17:39.181345 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Sep 20 22:17:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:40.404581 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-22565a42-6b1a-4bae-a2e8-6945bf264edc admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:40.405614 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-22565a42-6b1a-4bae-a2e8-6945bf264edc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 20 22:17:40.406001 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 20 22:17:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:17:40.932959 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-eb95ed87-62db-4691-b4c5-343ecf197551 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:40.939235 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.wsgi [None req-eb95ed87-62db-4691-b4c5-343ecf197551 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-eb95ed87-62db-4691-b4c5-343ecf197551 admin admin] Request method failure captured: Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Accept: application/json Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Accept-Encoding: gzip, deflate Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Connection: keep-alive Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Content-Length: 0 Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Host: 10.222.0.16 Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Openstack-Api-Version: compute 2.92 Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Openstack-System-Scope: None Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: User-Agent: python-novaclient Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Auth-Token: gAAAAABjKjwEqh3utZu91bsuRgQBtpXLwGxe_aly02GOL_VQW2JKqweLVPtFfEjJ3jTJCfd4kEAGQQoFJlah-BY94r-CoFnbcXVQgCv7Wi1OFsaI_MIZiIjAa7caS3epowEwVf4CuVHstNHAr91FIhyERktL01_ARR7PC52tVr42ngeybFRvuDM Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Domain-Id: None Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Domain-Name: None Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Identity-Status: Confirmed Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Is-Admin-Project: True Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Openstack-Nova-Api-Version: 2.92 Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Project-Domain-Id: default Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Project-Domain-Name: Default Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Project-Id: c43595da141a4fa38e7ea2e26db5eba9 Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Project-Name: admin Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Role: reader,member,admin Sep 20 22:17:40.940738 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Roles: reader,member,admin Sep 20 22:17:40.942309 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c43595da141a4fa38e7ea2e26db5eba9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c43595da141a4fa38e7ea2e26db5eba9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c43595da141a4fa38e7ea2e26db5eba9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c43595da141a4fa38e7ea2e26db5eba9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:17:40.942309 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Tenant: admin Sep 20 22:17:40.942309 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Tenant-Id: c43595da141a4fa38e7ea2e26db5eba9 Sep 20 22:17:40.942309 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-Tenant-Name: admin Sep 20 22:17:40.942309 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-User: admin Sep 20 22:17:40.942309 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-User-Domain-Id: default Sep 20 22:17:40.942309 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-User-Domain-Name: Default Sep 20 22:17:40.942309 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-User-Id: 5610cc76f5f445f4ab3b97181fd1e7ed Sep 20 22:17:40.942309 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: X-User-Name: admin Sep 20 22:17:40.942309 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: method: > Sep 20 22:17:40.942309 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: exception: Flavor 451 could not be found. Sep 20 22:17:40.942309 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: action_args: {'id': '451'} Sep 20 22:17:40.942309 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:17:40.942309 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:17:40.943299 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:17:40.944632 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:17:40.944632 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:17:40.944632 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:17:40.944632 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:17:40.944632 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 20 22:17:40.944632 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:17:40.944632 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 20 22:17:40.944632 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 20 22:17:40.944632 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:17:40.944632 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 20 22:17:40.944632 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:17:40.944632 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:17:40.944632 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:17:40.944632 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:17:40.944632 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:17:40.944632 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 20 22:17:40.944632 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 20 22:17:40.944632 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-eb95ed87-62db-4691-b4c5-343ecf197551 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:17:40.945876 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-eb95ed87-62db-4691-b4c5-343ecf197551 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.393114 Sep 20 22:17:40.945876 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Sep 20 22:17:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:40.951867 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-62c472c3-0661-47a1-b436-32212a419a66 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:40.967355 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-62c472c3-0661-47a1-b436-32212a419a66 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019065 Sep 20 22:17:40.967870 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Sep 20 22:17:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:17:40.977142 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7d919e43-dc74-43e8-8178-17099b04b7a1 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:40.992500 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-7d919e43-dc74-43e8-8178-17099b04b7a1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018862 Sep 20 22:17:40.993037 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Sep 20 22:17:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:17:41.002659 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-7edbed98-80d9-4661-98ad-4ca8d521ce5f admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:41.007541 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.wsgi [None req-7edbed98-80d9-4661-98ad-4ca8d521ce5f admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-7edbed98-80d9-4661-98ad-4ca8d521ce5f admin admin] Request method failure captured: Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Accept: application/json Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Accept-Encoding: gzip, deflate Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Connection: keep-alive Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Content-Length: 0 Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Host: 10.222.0.16 Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Openstack-Api-Version: compute 2.92 Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Openstack-System-Scope: None Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: User-Agent: python-novaclient Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Auth-Token: gAAAAABjKjwEqh3utZu91bsuRgQBtpXLwGxe_aly02GOL_VQW2JKqweLVPtFfEjJ3jTJCfd4kEAGQQoFJlah-BY94r-CoFnbcXVQgCv7Wi1OFsaI_MIZiIjAa7caS3epowEwVf4CuVHstNHAr91FIhyERktL01_ARR7PC52tVr42ngeybFRvuDM Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Domain-Id: None Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Domain-Name: None Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Identity-Status: Confirmed Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Is-Admin-Project: True Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Openstack-Nova-Api-Version: 2.92 Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Project-Domain-Id: default Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Project-Domain-Name: Default Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Project-Id: c43595da141a4fa38e7ea2e26db5eba9 Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Project-Name: admin Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Role: reader,member,admin Sep 20 22:17:41.009068 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Roles: reader,member,admin Sep 20 22:17:41.010568 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c43595da141a4fa38e7ea2e26db5eba9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c43595da141a4fa38e7ea2e26db5eba9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c43595da141a4fa38e7ea2e26db5eba9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c43595da141a4fa38e7ea2e26db5eba9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:17:41.010568 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Tenant: admin Sep 20 22:17:41.010568 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Tenant-Id: c43595da141a4fa38e7ea2e26db5eba9 Sep 20 22:17:41.010568 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-Tenant-Name: admin Sep 20 22:17:41.010568 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-User: admin Sep 20 22:17:41.010568 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-User-Domain-Id: default Sep 20 22:17:41.010568 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-User-Domain-Name: Default Sep 20 22:17:41.010568 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-User-Id: 5610cc76f5f445f4ab3b97181fd1e7ed Sep 20 22:17:41.010568 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: X-User-Name: admin Sep 20 22:17:41.010568 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: method: > Sep 20 22:17:41.010568 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: exception: Flavor 451 could not be found. Sep 20 22:17:41.010568 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: action_args: {'id': '451'} Sep 20 22:17:41.010568 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:17:41.010568 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:17:41.011547 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:17:41.012956 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:17:41.012956 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:17:41.012956 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:17:41.012956 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:17:41.012956 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 20 22:17:41.012956 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:17:41.012956 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 20 22:17:41.012956 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Sep 20 22:17:41.012956 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:17:41.012956 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Sep 20 22:17:41.012956 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:17:41.012956 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:17:41.012956 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:17:41.012956 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:17:41.012956 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:17:41.012956 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 20 22:17:41.012956 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: ERROR nova.api.openstack.wsgi Sep 20 22:17:41.012956 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-7edbed98-80d9-4661-98ad-4ca8d521ce5f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:17:41.014212 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-7edbed98-80d9-4661-98ad-4ca8d521ce5f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011843 Sep 20 22:17:41.014212 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Sep 20 22:17:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:42.216915 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7d919e43-dc74-43e8-8178-17099b04b7a1 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:42.217945 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-7d919e43-dc74-43e8-8178-17099b04b7a1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 20 22:17:42.218330 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 20 22:17:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:17:42.738813 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-a1a03df6-062e-44a4-96ed-2285600e9cad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:17:42.758264 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-a1a03df6-062e-44a4-96ed-2285600e9cad admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.403739 Sep 20 22:17:42.758795 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Sep 20 22:17:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 20 22:17:43.971362 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7d919e43-dc74-43e8-8178-17099b04b7a1 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:43.972357 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-7d919e43-dc74-43e8-8178-17099b04b7a1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 20 22:17:43.972742 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 20 22:17:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:17:44.489600 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-d3a111e9-2eb0-4df0-bcea-6f251ecfb7e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:17:44.507951 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-d3a111e9-2eb0-4df0-bcea-6f251ecfb7e6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.397108 Sep 20 22:17:44.508494 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Sep 20 22:17:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:17:45.745890 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7d919e43-dc74-43e8-8178-17099b04b7a1 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:45.746890 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-7d919e43-dc74-43e8-8178-17099b04b7a1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 20 22:17:45.747279 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 20 22:17:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:17:46.265564 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-0f2bb66e-a82f-46fa-9753-2e7135c1a957 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:17:46.284945 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-0f2bb66e-a82f-46fa-9753-2e7135c1a957 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.398026 Sep 20 22:17:46.285505 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Sep 20 22:17:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:17:47.493484 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7d919e43-dc74-43e8-8178-17099b04b7a1 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:47.494489 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-7d919e43-dc74-43e8-8178-17099b04b7a1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Sep 20 22:17:47.494878 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 20 22:17:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:17:48.015866 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-1e8ce7ac-702e-4aaa-81da-f9a112f7c2de admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:17:48.034414 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-1e8ce7ac-702e-4aaa-81da-f9a112f7c2de admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.402336 Sep 20 22:17:48.034895 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Sep 20 22:17:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:17:49.251723 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7d919e43-dc74-43e8-8178-17099b04b7a1 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:49.252720 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-7d919e43-dc74-43e8-8178-17099b04b7a1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 20 22:17:49.253151 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 20 22:17:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:17:49.776945 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-fec9059a-17c5-44a9-bb85-a7073dabb17d admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:17:49.797972 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-fec9059a-17c5-44a9-bb85-a7073dabb17d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401267 Sep 20 22:17:49.798509 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Tue Sep 20 22:17:49 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:18:45.954363 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7d919e43-dc74-43e8-8178-17099b04b7a1 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:18:45.955393 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-7d919e43-dc74-43e8-8178-17099b04b7a1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 20 22:18:45.955790 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 20 22:18:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:18:45.966371 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:46.339718 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-94c394e8-dde2-4348-9737-ac9d22106272 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:18:46.360313 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-94c394e8-dde2-4348-9737-ac9d22106272 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398439 Sep 20 22:18:46.360847 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Tue Sep 20 22:18:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:18:46.381609 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_api:SELECT=14 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:46.385370 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-ddd77359-f5ba-4989-8c76-a37eda18619d admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:18:46.393320 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-ddd77359-f5ba-4989-8c76-a37eda18619d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013121 Sep 20 22:18:46.393835 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Tue Sep 20 22:18:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:18:46.405760 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-9cb8ae3d-a95c-4c7f-bbf9-14ed25febbf4 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:18:46.413244 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-9cb8ae3d-a95c-4c7f-bbf9-14ed25febbf4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011461 Sep 20 22:18:46.413763 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Tue Sep 20 22:18:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:18:46.424919 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7453346e-f4a3-4e14-8029-838d1041f5b4 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:18:46.432137 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-7453346e-f4a3-4e14-8029-838d1041f5b4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010754 Sep 20 22:18:46.432639 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Tue Sep 20 22:18:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:18:46.443694 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-31fd1fe8-1d30-428a-b3ac-604cba0d36df admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:18:46.450630 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-31fd1fe8-1d30-428a-b3ac-604cba0d36df admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010426 Sep 20 22:18:46.451131 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Tue Sep 20 22:18:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:21:40.755613 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7453346e-f4a3-4e14-8029-838d1041f5b4 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:21:40.756689 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-7453346e-f4a3-4e14-8029-838d1041f5b4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 20 22:21:40.757083 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 20 22:21:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:21:40.894950 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_api:SELECT=6 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:21:41.051874 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-0b1f77a4-81ca-4314-9e4b-17d7edfc8b4f admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:21:41.057496 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-0b1f77a4-81ca-4314-9e4b-17d7edfc8b4f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:21:41.057977 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-0b1f77a4-81ca-4314-9e4b-17d7edfc8b4f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:21:41.058411 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-0b1f77a4-81ca-4314-9e4b-17d7edfc8b4f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:21:41.059139 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-0b1f77a4-81ca-4314-9e4b-17d7edfc8b4f admin admin] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:21:41.059650 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-0b1f77a4-81ca-4314-9e4b-17d7edfc8b4f admin admin] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:21:41.060130 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-0b1f77a4-81ca-4314-9e4b-17d7edfc8b4f admin admin] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:21:41.093817 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-0b1f77a4-81ca-4314-9e4b-17d7edfc8b4f admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.200136 Sep 20 22:21:41.094382 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Sep 20 22:21:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:21:42.181914 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7453346e-f4a3-4e14-8029-838d1041f5b4 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:21:42.182932 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-7453346e-f4a3-4e14-8029-838d1041f5b4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 20 22:21:42.183350 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 20 22:21:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:21:42.379063 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-c968686f-a4ab-43af-be55-bf92a1a9affd admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:21:42.382585 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-c968686f-a4ab-43af-be55-bf92a1a9affd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:21:42.383002 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-c968686f-a4ab-43af-be55-bf92a1a9affd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:21:42.383435 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-c968686f-a4ab-43af-be55-bf92a1a9affd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:21:42.384150 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-c968686f-a4ab-43af-be55-bf92a1a9affd admin admin] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:21:42.384601 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-c968686f-a4ab-43af-be55-bf92a1a9affd admin admin] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:21:42.385039 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-c968686f-a4ab-43af-be55-bf92a1a9affd admin admin] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:21:42.405377 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-c968686f-a4ab-43af-be55-bf92a1a9affd admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.082165 Sep 20 22:21:42.405926 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Sep 20 22:21:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:21:53.902679 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7453346e-f4a3-4e14-8029-838d1041f5b4 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:21:53.903752 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-7453346e-f4a3-4e14-8029-838d1041f5b4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 20 22:21:53.904149 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 20 22:21:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:21:54.050092 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_cell0:SELECT=4 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:21:54.050829 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_cell1:SELECT=4 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:21:54.051449 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG dbcounter [-] [105476] Writing DB stats nova_api:SELECT=8 {{(pid=105476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:21:54.097975 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-b3b8362f-f18d-435f-8601-b62e223386df admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:21:54.101388 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-b3b8362f-f18d-435f-8601-b62e223386df admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:21:54.101864 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-b3b8362f-f18d-435f-8601-b62e223386df admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:21:54.102296 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-b3b8362f-f18d-435f-8601-b62e223386df admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:21:54.103009 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-b3b8362f-f18d-435f-8601-b62e223386df admin admin] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:21:54.103460 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-b3b8362f-f18d-435f-8601-b62e223386df admin admin] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:21:54.103878 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-b3b8362f-f18d-435f-8601-b62e223386df admin admin] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:21:54.129417 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-b3b8362f-f18d-435f-8601-b62e223386df admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.084303 Sep 20 22:21:54.129902 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Sep 20 22:21:54 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:21:55.202440 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7453346e-f4a3-4e14-8029-838d1041f5b4 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:21:55.203443 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-7453346e-f4a3-4e14-8029-838d1041f5b4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Sep 20 22:21:55.203836 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 20 22:21:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:21:55.394459 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG nova.api.openstack.wsgi [None req-8a7d2fdd-0cc1-4c28-b056-12d9de6d7e14 admin admin] Calling method '>' {{(pid=105476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:21:55.397856 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-8a7d2fdd-0cc1-4c28-b056-12d9de6d7e14 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:21:55.398337 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-8a7d2fdd-0cc1-4c28-b056-12d9de6d7e14 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:21:55.398768 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-8a7d2fdd-0cc1-4c28-b056-12d9de6d7e14 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:21:55.399484 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-8a7d2fdd-0cc1-4c28-b056-12d9de6d7e14 admin admin] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:21:55.399936 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-8a7d2fdd-0cc1-4c28-b056-12d9de6d7e14 admin admin] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:21:55.400357 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: DEBUG oslo_concurrency.lockutils [None req-8a7d2fdd-0cc1-4c28-b056-12d9de6d7e14 admin admin] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:21:55.422536 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: INFO nova.api.openstack.requestlog [None req-8a7d2fdd-0cc1-4c28-b056-12d9de6d7e14 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079527 Sep 20 22:21:55.423020 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: [pid: 105476|app: 0|req: 39/76] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Sep 20 22:21:55 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:22:50.920904 dv-cinder-858276-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 20 22:22:50.921505 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: Tue Sep 20 22:22:50 2022 - graceful shutdown triggered... Sep 20 22:22:50.921986 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: Gracefully killing worker 2 (pid: 105477)... Sep 20 22:22:50.922421 dv-cinder-858276-1-iscsi devstack@n-api.service[105476]: Gracefully killing worker 1 (pid: 105476)... Sep 20 22:22:51.050159 dv-cinder-858276-1-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_api:SELECT=4 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:22:51.922317 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: worker 1 buried after 1 seconds Sep 20 22:22:51.922731 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: worker 2 buried after 1 seconds Sep 20 22:22:51.922731 dv-cinder-858276-1-iscsi devstack@n-api.service[105475]: goodbye to uWSGI. Sep 20 22:22:51.923903 dv-cinder-858276-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 20 22:22:51.924443 dv-cinder-858276-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 20 22:22:51.927267 dv-cinder-858276-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 20 22:22:51.936411 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 20 22:22:51.938437 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 20 22:22:51 2022] *** Sep 20 22:22:51.938437 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 20 22:22:51.938437 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 20 22:22:51.938437 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: nodename: dv-cinder-858276-1-iscsi Sep 20 22:22:51.938437 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: machine: x86_64 Sep 20 22:22:51.938437 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: clock source: unix Sep 20 22:22:51.938437 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: pcre jit disabled Sep 20 22:22:51.938437 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: detected number of CPU cores: 4 Sep 20 22:22:51.938437 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: current working directory: / Sep 20 22:22:51.938437 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: detected binary path: /usr/bin/uwsgi-core Sep 20 22:22:51.938437 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: your processes number limit is 47680 Sep 20 22:22:51.938437 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: your memory page size is 4096 bytes Sep 20 22:22:51.939181 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: detected max file descriptor number: 2048 Sep 20 22:22:51.939181 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: lock engine: pthread robust mutexes Sep 20 22:22:51.939181 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: thunder lock: enabled Sep 20 22:22:51.939181 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 20 22:22:51.939181 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 20 22:22:51.980390 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: Python main interpreter initialized at 0x55beb4d2b9c0 Sep 20 22:22:51.980390 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: python threads support enabled Sep 20 22:22:51.980390 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: your server socket listen backlog is limited to 100 connections Sep 20 22:22:51.980390 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: your mercy for graceful operations on workers is 90 seconds Sep 20 22:22:51.980828 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: mapped 403077 bytes (393 KB) for 2 cores Sep 20 22:22:51.980828 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: *** Operational MODE: preforking *** Sep 20 22:22:51.981123 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: *** uWSGI is running in multiple interpreter mode *** Sep 20 22:22:51.981123 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: spawned uWSGI master process (pid: 120456) Sep 20 22:22:51.981329 dv-cinder-858276-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 20 22:22:51.982180 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: spawned uWSGI worker 1 (pid: 120473, cores: 1) Sep 20 22:22:51.982315 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: spawned uWSGI worker 2 (pid: 120474, cores: 1) Sep 20 22:22:51.982630 dv-cinder-858276-1-iscsi devstack@n-api.service[120456]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 20 22:22:52.637416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 20 22:22:52.645552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 20 22:22:53.792136 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 22:22:53.792136 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: from cryptography.utils import int_from_bytes Sep 20 22:22:53.792792 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 22:22:53.792792 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: from cryptography.utils import int_from_bytes Sep 20 22:22:53.808457 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 22:22:53.808457 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: from cryptography.utils import int_from_bytes Sep 20 22:22:53.809048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 22:22:53.809048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: from cryptography.utils import int_from_bytes Sep 20 22:22:56.222003 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 20 22:22:56.222578 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 20 22:22:56.222881 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 20 22:22:56.223173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 20 22:22:56.223424 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 20 22:22:56.223812 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.224140 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.224459 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.224779 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.225148 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.225465 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.225801 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.226109 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.226438 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.226699 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.227031 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.227515 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858276-1-iscsi {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.227843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.228158 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.228472 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.228797 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.229209 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.229535 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.229843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.230351 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.231930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.232827 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.233178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.233570 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.233903 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.234230 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.234555 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.234862 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.235198 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.235498 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.235925 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858276-1-iscsi {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.236405 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.236692 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.237420 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.237634 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.237900 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.238289 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.238727 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.239017 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.239582 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.239915 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.240244 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.240565 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.240887 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.241319 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.241540 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.241862 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.242181 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.242497 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.243050 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.243050 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.243329 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.243642 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.243964 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.244285 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.244539 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.244904 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.246666 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.246666 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.246666 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.246666 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.246666 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.247029 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.247029 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.247355 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.247662 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.248075 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.248398 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.248901 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.249427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.249942 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.250439 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.250849 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.251135 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.251409 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.251755 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.252073 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.252531 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.253059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.253375 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.253712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.253996 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.254338 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.254629 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.254906 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 20 22:22:56.255414 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.255414 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.255574 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 20 22:22:56.255653 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.255835 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.255965 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 20 22:22:56.256243 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 20 22:22:56.256506 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 20 22:22:56.256743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.256894 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.257249 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.257565 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.257686 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.257883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.257989 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.258198 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.258301 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.258508 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.258613 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.258819 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.258926 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.259128 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.259263 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.259433 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.259553 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.259699 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.260001 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.260105 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.260318 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.260452 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858276-1-iscsi {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.260632 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.260945 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.261275 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.261378 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.261582 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.261761 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.261885 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.262018 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.262207 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.262474 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.262578 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.262805 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.262909 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.263122 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.263716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.264304 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.264393 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.264491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.264579 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.264651 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.264749 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.264874 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.265203 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.265515 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.265638 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.265821 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.266145 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.266423 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.266536 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.266830 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.267158 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.267268 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.267469 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.267774 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.268061 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.268242 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.268407 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.268552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.268715 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.268871 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.269076 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.269251 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.269399 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.269592 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.269775 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.269929 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858276-1-iscsi {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.270081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.270234 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.270383 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.270568 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.270752 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.270911 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.271054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.271054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.271343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.271496 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.271640 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.271782 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.271938 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.272089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.272239 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.272397 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.272541 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.272683 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.272845 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.273015 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.273164 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.273324 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.273479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.275483 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.275656 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.275804 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.275958 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.276110 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.276253 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.276253 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.276570 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.276745 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.277168 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.277332 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.277476 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.277651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.277826 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.277977 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.278133 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.278276 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.278604 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.278758 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.278981 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.279704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.279862 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.280025 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.280175 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.280330 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.280478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.280629 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.280783 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.280933 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.281146 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.281303 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.281471 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.281621 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.281767 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.281918 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.282067 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.282216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.282216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.282494 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.282643 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.282793 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.282935 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.283076 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.283237 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.283396 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.283538 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.283679 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.283829 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.283971 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.284121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.284271 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.284422 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.284873 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.285051 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.285232 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.285446 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.285609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.285763 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.285918 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.286066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.286217 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.286359 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.286501 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.286649 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.286791 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.286941 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.287103 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.287249 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.287398 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.287549 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.287698 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.287840 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.287991 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.288133 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.288284 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.288433 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.288575 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.288728 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.288878 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.289050 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.289199 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.289340 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.289502 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.289653 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.289823 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.289973 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.290116 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.290264 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.290414 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.290565 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.290708 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.290858 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.291008 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.291150 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.291301 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.291471 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.291613 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.291613 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.291897 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.292047 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.292197 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.292347 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.292496 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.292637 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.292778 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.292919 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.293217 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.293372 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.293526 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.293675 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.293817 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.293957 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.294181 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.294334 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.294502 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.294675 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.295097 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.295248 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.295406 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.295634 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.295780 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.295942 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.296084 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.296225 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.296386 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.296541 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.296695 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.296843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.297005 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.297156 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.297311 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.297467 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.297610 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.297768 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.297926 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.298076 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.298217 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.298359 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.298510 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.298658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.298813 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.298955 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.299096 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.299237 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.299378 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.299551 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.299713 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.299863 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.300006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.300155 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.300296 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.300446 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.300590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.300733 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.300875 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.301089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.301242 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.301397 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.301547 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.301704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.301861 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.302004 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.302146 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.302146 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.302432 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.302582 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.302725 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.302866 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.303016 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.303167 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.303309 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.303467 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.303617 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.303767 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.303918 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.304059 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.304208 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.304357 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.304499 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.304646 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.304801 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.305249 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.305415 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.305568 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.305813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.305964 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.306119 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.306269 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.306411 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.306560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:22:56.306702 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.306857 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.307021 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.307178 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.307327 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.307477 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.307620 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.307785 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.307929 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.308079 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.308223 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.308373 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.308515 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.308669 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.308819 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.309022 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.309184 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.309346 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.309982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.310116 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.310214 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.310301 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.310385 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.310478 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.310577 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.310664 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.310747 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.310828 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.310911 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.310993 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.311128 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.311215 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.311307 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.311398 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.311489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.311580 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.311673 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.311766 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.311851 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.311933 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.312021 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.312113 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.312206 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.312297 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.312382 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.312471 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.312555 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.312651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.312651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.312803 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.312885 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.312885 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.313055 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.313160 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.313253 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.313343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.313343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.313502 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.313584 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.313679 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.313770 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.313853 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.313934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.313934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.314092 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.314187 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.314272 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.314361 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.314444 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.314532 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.314628 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.314712 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.314794 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.314875 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.314963 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.315057 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.315150 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.315344 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.315437 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.315658 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.315758 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.315967 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.316072 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.316304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.316404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.316611 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.316701 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.316920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.317167 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.317271 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.317376 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.317560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.317759 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.317918 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.318080 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.318232 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.318394 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.318543 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.318699 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.318858 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.319137 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.319308 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.319470 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.319618 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.319784 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.319985 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.320145 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.320313 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.320471 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.320632 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.320780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.320937 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.321127 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.321289 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.321438 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.321595 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.321758 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.321917 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.322077 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.322233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.322392 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.322548 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.322721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.322871 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.323035 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.323211 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.323378 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.323536 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.323700 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.323857 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.324005 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.324161 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.324310 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.324464 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.324632 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.324828 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.325015 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.325182 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.325631 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.326377 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.326549 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.326707 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.326858 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.327022 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.327179 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.327337 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.327487 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.327647 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.327795 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.327944 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.328092 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.328248 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.328403 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.328551 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.328711 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.328868 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.329070 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.329244 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.329402 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.329551 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.329720 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.329877 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.330077 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.330247 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.330397 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.330551 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.330718 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.330899 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.332384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.333088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.333184 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.333265 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.333355 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.333449 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.333542 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.333634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.333725 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.333816 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.333900 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.333996 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.334075 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.334153 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.334231 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.334303 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.334380 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.334460 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.334538 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.334629 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.334714 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.334795 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.334899 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.334973 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.335044 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.335119 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.335216 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.335307 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.335404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.335497 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.335569 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.335659 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.335743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.335826 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.335921 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.336014 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.336105 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.336189 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.336259 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.336341 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.336436 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.336521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.336615 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.336705 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.336789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.336884 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.336990 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.337078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.337078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.337227 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.337310 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.337410 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.337497 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.337586 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.337843 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.337954 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.338114 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.338258 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.338423 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.338580 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.338733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.339460 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.339590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.339680 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.339763 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.339854 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.339950 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.340035 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.340179 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.340280 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.340367 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.340450 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.340546 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.340713 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.340848 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.341047 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.341181 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.342037 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.342130 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.342216 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.342445 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.342538 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.342779 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.342880 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.343097 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.343289 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.343400 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.343500 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.343705 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.343804 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.344013 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.344201 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.344367 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.344453 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.344612 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.344706 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.344919 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.345037 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.345254 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.345355 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.345572 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.345670 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.345878 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.345982 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.346183 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.346276 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.346488 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.346588 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.346793 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.346893 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.347097 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.347194 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.347415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.347528 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.347748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.347867 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.348063 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.348178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.348386 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.348485 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.348699 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.348792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.349041 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.349160 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.349356 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.349462 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.349660 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.349771 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.349967 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.350073 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.350268 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.350368 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.350578 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.350668 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.350881 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.350972 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.351181 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.351280 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.351487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.351586 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.351792 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.351882 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.352097 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.352201 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.352401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.352492 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.352702 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.352800 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.353030 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.353137 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.353342 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.353439 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.353644 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.353743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.353943 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.354045 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.354244 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.354334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.354548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.354640 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.354854 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.354954 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.355159 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.355250 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.355459 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.355558 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.355767 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.355859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.356066 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.356158 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.356379 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.356478 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.356681 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.356790 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.357032 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.357143 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.357342 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.357435 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.357645 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.357745 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.357979 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.358091 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.358283 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.358388 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.358583 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.358683 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.358896 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.358987 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.359202 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.359341 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.359506 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.359602 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.359811 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.359904 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.360112 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.360213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.360413 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.360506 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.360718 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.360819 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.361058 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.361171 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.361371 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.361465 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.361672 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.361762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.361978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.362083 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.362279 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.362377 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.362583 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.362675 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.362887 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.362987 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.363194 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.363291 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.363495 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.363586 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.363796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.363897 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.364096 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.364457 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.364660 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.364751 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.364962 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.365116 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.365305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.365554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.365647 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.365886 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.365991 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.366192 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.366283 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.366495 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.366600 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.366836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.366928 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.367140 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.367238 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.367468 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.367561 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.367791 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.367889 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.368099 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.368199 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.368404 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.368512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.368709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.368810 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.369032 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.369141 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.369340 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.369454 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.369643 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.369755 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.369940 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.370040 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.370243 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.370343 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.370545 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.370645 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.370847 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.370953 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.371145 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.371236 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.371446 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.371546 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.371749 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.371854 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.372053 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.372152 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.372366 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.372457 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.372696 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.372799 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.373023 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.373132 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.373329 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.373421 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.373636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.373734 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.373945 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.374039 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.374246 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.374336 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.374550 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.374645 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.374851 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.374944 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.375160 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.375252 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.375473 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.375574 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.375786 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.375885 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.376097 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.376190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.376410 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.376503 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.376720 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.376819 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.377058 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.377167 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.377372 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.377474 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.377672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.377768 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.377977 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.378079 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.378281 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.378381 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.378585 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.378688 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.378884 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.378989 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.379185 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.379286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.379492 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.379604 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.379793 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.379898 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.380102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.380226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.380410 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.380538 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.380711 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.380849 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.381039 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.381184 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.381345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.381494 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.381665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.381807 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.381953 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.382123 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.382255 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.382437 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.382547 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.382742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.382841 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.383139 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.383237 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.383440 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.383542 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.383746 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.383847 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.384045 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.384137 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.384354 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.384453 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.384653 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.384751 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.384954 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.385072 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.385276 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.385375 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.385584 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.385684 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.385888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.385985 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.386187 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.386315 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.386507 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.386602 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.386812 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.386912 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.387112 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.387210 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.387413 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.387539 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.387720 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.387853 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.388021 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.388159 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.388858 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.389127 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.389237 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.389444 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.389552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.389759 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.389864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.390082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.390178 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.390387 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.390487 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.390691 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.390791 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.390994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.391096 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.391299 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.391401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.391605 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.391706 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.391907 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.392013 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.392208 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.392308 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.392509 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.392601 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.392810 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.392912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.393135 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.393240 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.393459 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.393560 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.393767 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.393874 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.394069 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.394169 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.394371 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.394463 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.394673 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.394779 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.395018 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.395118 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.395325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.395425 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.395688 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.395788 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.395996 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.396096 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.396313 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.396411 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.396621 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.396714 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.396934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.397066 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.397264 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.397364 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.397573 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.397676 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.397877 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.397970 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.398191 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.398289 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.398499 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.398590 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.398807 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.398951 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.399109 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.399214 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.399411 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.399503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.399713 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.399825 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.400030 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.400147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.400331 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.400422 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.400648 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.400739 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.400959 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.401083 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.401304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.401403 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.401607 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.401700 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.401914 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.402015 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.402224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.402331 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.402532 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.402623 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.402834 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.402935 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.403142 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.403233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.403445 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.403590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.403816 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.404450 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.404640 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.404781 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.404963 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.405130 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.405317 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.405452 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.405651 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.405764 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.405966 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.406080 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.406303 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.406396 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.406630 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.406724 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.406951 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.407081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.407262 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.407356 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.407582 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.407718 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.407898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.408032 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.408200 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.408303 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.408507 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.408610 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.408810 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.408902 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.409138 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.409273 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.409444 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.409591 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.409746 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.409907 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.410078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.410204 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.410339 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.410515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.410636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.410829 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.410924 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.411147 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.411246 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.411464 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.411557 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.411771 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.411871 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.412142 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.412243 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.412450 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.412576 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.412757 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.412893 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.413085 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.413193 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.413404 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.413503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.413710 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.413811 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.414023 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.414129 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.414333 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.414431 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.414639 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.414744 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.414947 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.415048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.415252 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.415351 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.415562 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.415660 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.415866 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.415965 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.416176 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.416275 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.416488 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.416581 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.416802 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.416895 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.417137 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.417244 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.417453 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.417614 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.417765 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.417928 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.418081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.418239 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.418563 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.418653 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.418886 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.419024 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.419213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.419318 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.419547 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.419651 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.419861 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.419961 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.420170 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.420305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.420481 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.420581 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.420792 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.420920 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.421130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.421236 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.421442 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.421545 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.421745 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.421836 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.422067 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.422167 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.422386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.422491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.422698 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.422795 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.423022 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.423114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.423338 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.423438 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.423655 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.423756 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.423969 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.424062 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.424284 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.424386 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.424639 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.424742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.424952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.425091 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.425278 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.425376 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.425590 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.425681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.425891 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.425990 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.426197 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.426290 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.426505 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.426596 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.426814 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.426916 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.427124 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.427263 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.427433 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.427567 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.427739 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.427874 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.428044 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.428144 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.428349 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.428448 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.428659 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.428791 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.428962 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.429112 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.429307 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.429403 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.429621 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.429724 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.429934 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.430025 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.430248 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.430384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.430552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.430645 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.430877 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.431072 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.431190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.431384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.431487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.431714 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.431813 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.432038 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.432130 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.432361 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.432454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.432677 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.432770 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.433022 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.433120 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.433342 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.433437 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.433653 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.433753 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.433958 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.434050 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.434269 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.434363 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.434576 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.434669 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.434877 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.434982 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.435223 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.435318 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.435536 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.435635 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.435839 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.435941 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.436149 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.436239 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.436453 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.436558 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.436763 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.437002 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.437108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.437358 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.437458 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.437671 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.437762 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.437981 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.438082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.438287 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.438379 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.438589 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.438695 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.438893 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.438986 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.439213 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.439349 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.439516 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.439619 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.439819 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.439917 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.440131 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.440224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.440432 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.440532 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.440734 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.440832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.441057 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.441154 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.441372 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.441483 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.441681 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.441781 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.441986 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.442088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.442296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.442397 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.442598 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.442698 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.442917 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.443008 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.443222 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.443315 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.443532 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.443630 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.443834 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.443933 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.444144 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.444246 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.444447 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.444540 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.444750 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.444843 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.445077 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.445184 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.445383 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.445484 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.445691 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.445795 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.445990 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.446090 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.446382 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.446518 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.446687 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.446851 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.446995 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.447168 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.447343 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.447484 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.447652 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.447789 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.447955 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.448082 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.448276 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.448404 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.448581 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.448684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.448883 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.449014 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.449219 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.449333 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.449527 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.449631 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.449845 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.449960 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.450155 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.450282 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.450463 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.450592 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.451337 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.451464 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.451654 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.451784 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.452100 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.452199 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.452415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.452515 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.452729 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.452830 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.453106 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.453204 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.453467 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.453606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.453701 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.453797 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.454016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.454110 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.454330 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.454422 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.454642 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.454743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.454952 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.455045 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.455260 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.455361 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.455573 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.455673 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.455879 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.455969 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.456186 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.456287 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.456493 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.456593 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.456798 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.456890 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.457132 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.457217 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.457442 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.457525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.457749 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.457880 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.458056 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.458197 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.458361 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.458461 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.458668 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.458762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.458974 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.459080 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.459286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.459491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.459626 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.459807 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.459943 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.460139 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.460240 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.460465 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.460556 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.460788 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.460889 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.461127 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.461233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.461442 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.461587 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.461769 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.461877 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.462075 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.462177 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.462380 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.462479 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.462688 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.462859 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.462996 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.463090 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.463297 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.463388 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.463615 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.463714 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.463924 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.464024 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.464225 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.464319 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.464540 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.464641 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.464848 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.464946 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.465234 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.465406 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.465554 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.465753 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.465847 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.466068 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.466160 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.467021 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.467139 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.467345 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.467443 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.467662 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.467806 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.467970 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.468064 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.468297 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.468396 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.468598 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.468697 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.468901 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.469020 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.469241 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.469340 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.469546 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.469681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.469849 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.469941 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.470154 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.470245 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.470456 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.470550 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.470756 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.470856 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.471060 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.471158 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.471356 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.471460 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.471655 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.471748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.471956 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.472106 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.472257 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.472359 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.472560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.472650 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.472854 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.472946 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.473180 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.473290 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.473481 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.473582 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.473781 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.473873 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.474081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.474180 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.474378 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.474469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.474682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.474783 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.474982 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.475074 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.475280 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.475370 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.475580 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.475680 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.475879 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.475973 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.476177 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.476276 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.476505 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.476606 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.476834 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.476927 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.477172 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.477267 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.477495 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.477595 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.477797 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.477888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.478110 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.478203 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.478414 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.478519 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.478731 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.478829 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.479041 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.479134 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.479348 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.479448 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.479654 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.479802 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.479981 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.480075 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.480289 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.480511 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.480604 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.480844 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.480936 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.481191 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.481301 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.481503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.481602 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.481809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.481903 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.482159 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.482261 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.482462 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.482600 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.482767 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.482860 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.483088 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.483189 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.483393 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.483484 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.483704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.483797 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.484013 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.484119 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.484319 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.484418 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.484621 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.484712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.484926 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.485063 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.485258 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.485351 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.485562 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.485667 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.485867 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.485966 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.486170 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.486268 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.486477 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.486580 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.486782 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.486880 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.487087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.487179 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.487391 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.487497 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.487700 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.487798 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.488023 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.488119 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.488339 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.488476 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.488641 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.488733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.488952 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.489064 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.489561 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.489668 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.489871 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.489963 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.490179 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.490272 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.490488 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.490581 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.490794 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.490886 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.491107 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.491203 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.491429 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.491522 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.491734 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.491833 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.491978 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 20 22:22:56.492071 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.492435 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.492745 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.493097 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.493414 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.493719 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.494037 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.494355 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.494661 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.494977 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.495287 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.495613 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.495949 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.496276 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.496597 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.496901 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.497231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.497536 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.497867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.498182 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.498489 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.498790 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.499089 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.499395 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.499695 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.499996 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.500296 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.500596 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.500899 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.501224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.501524 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.501824 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.502123 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.502421 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.502719 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.503023 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.503320 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.503621 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.503919 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.504220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.504518 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.504845 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.505198 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.505510 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.505907 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.506222 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.506542 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.506850 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.507175 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.507496 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.507808 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.508180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.508438 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.508746 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.509082 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.509392 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.509702 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.510009 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.510315 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.510639 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.510966 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.511272 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.511594 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.511910 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.512225 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.512537 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.512843 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.513692 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.514013 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.514324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.514631 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.514941 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.515249 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.515563 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.515871 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.516179 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.516491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.516804 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.517150 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.517474 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.517787 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.518109 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.518433 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.518775 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.519085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.519424 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.519748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.520061 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.520371 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.520674 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:22:56.520917 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 20 22:22:56.553822 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO dbcounter [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] Registered counter for database nova_api Sep 20 22:22:56.573810 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_db.sqlalchemy.engines [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 22:22:56.580688 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writer thread running {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 22:22:56.583005 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO dbcounter [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] Registered counter for database nova_api Sep 20 22:22:56.603683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_db.sqlalchemy.engines [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 22:22:56.610310 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writer thread running {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 22:22:56.637456 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.context [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aaca181d-8f33-4223-a648-2988e81860b3(cell1) {{(pid=120473) load_cells /opt/stack/nova/nova/context.py:464}} Sep 20 22:22:56.642022 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:22:56.642499 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:22:56.644054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:22:56.644780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:22:56.645317 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:22:56.647327 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:22:56.649323 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO dbcounter [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] Registered counter for database nova_cell0 Sep 20 22:22:56.653292 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO dbcounter [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] Registered counter for database nova_cell1 Sep 20 22:22:56.660157 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_db.sqlalchemy.engines [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 22:22:56.662571 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_db.sqlalchemy.engines [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 22:22:56.666650 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.context [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aaca181d-8f33-4223-a648-2988e81860b3(cell1) {{(pid=120474) load_cells /opt/stack/nova/nova/context.py:464}} Sep 20 22:22:56.668232 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writer thread running {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 22:22:56.669567 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writer thread running {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 22:22:56.670820 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:22:56.671303 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:22:56.672846 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:22:56.673606 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:22:56.674048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:22:56.676044 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:22:56.678059 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO dbcounter [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] Registered counter for database nova_cell0 Sep 20 22:22:56.682124 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO dbcounter [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] Registered counter for database nova_cell1 Sep 20 22:22:56.689748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_db.sqlalchemy.engines [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 22:22:56.691876 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_db.sqlalchemy.engines [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 22:22:56.696881 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writer thread running {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 22:22:56.702672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writer thread running {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 22:22:56.818278 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO dbcounter [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] Registered counter for database nova_cell0 Sep 20 22:22:56.826900 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_db.sqlalchemy.engines [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 22:22:56.832905 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writer thread running {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 22:22:56.845672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO dbcounter [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] Registered counter for database nova_cell0 Sep 20 22:22:56.854790 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_db.sqlalchemy.engines [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 22:22:56.859594 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writer thread running {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 22:22:57.164523 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: WARNING keystonemiddleware.auth_token [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 20 22:22:57.173454 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: WARNING keystonemiddleware.auth_token [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 20 22:22:57.198236 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: WARNING keystonemiddleware.auth_token [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 20 22:22:57.205865 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: WARNING keystonemiddleware.auth_token [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 20 22:22:57.529940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: WARNING keystonemiddleware.auth_token [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 20 22:22:57.536051 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: WARNING keystonemiddleware.auth_token [None req-819dd3cc-58b3-4e9a-8d33-f45fe0555c12 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 20 22:22:57.541462 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55beb4d2b9c0 pid: 120473 (default app) Sep 20 22:22:57.558391 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: WARNING keystonemiddleware.auth_token [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 20 22:22:57.564576 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: WARNING keystonemiddleware.auth_token [None req-c5bea5c8-1902-42b1-9f92-e49cefddbcd2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 20 22:22:57.569936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55beb4d2b9c0 pid: 120474 (default app) Sep 20 22:23:32.795916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=3 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:32.797388 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=3 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:32.798572 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=3 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:32.800358 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=3 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:33.271818 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=3 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:33.273901 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=3 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:33.294981 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=3 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:33.296961 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=3 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:34.182617 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-704bbbfe-b43c-4999-8a43-40f42215240c tempest-VolumesGetTestJSON-684626688 tempest-VolumesGetTestJSON-684626688-project] Action: 'create', calling method: .version_select at 0x7f24f784d430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1508939447", "metadata": {"Type": "work"}}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:23:34.675006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5ddfcb39-e12b-4c44-b66e-b00cc94a56a8 tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] Action: 'create', calling method: .version_select at 0x7f24f784e4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-644716831", "metadata": {"Type": "work"}}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5ddfcb39-e12b-4c44-b66e-b00cc94a56a8 tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] Request method failure captured: Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 121 Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj1lU0LVvjoaiG6zKgfliaZ-0fPa9zb6o6nvC_UsYlSRy6OduqxvdwAhHXuYxfP-rtbN2NtdVtAEyIzrXazm3Z9YlsQt5NcmApGdNPZaZ3uOGDsBrRbnwSXfycnG0Qs7SPjKHEMxJ8mDoLgbhSDj5jhCvxirUciF1jAk1izbbYOIRyo Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: ded8453182d34898a1ec7c51012590e2 Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-VolumesNegativeTest-1988380099 Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:23:34.683773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:23:34.685345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ded8453182d34898a1ec7c51012590e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ded8453182d34898a1ec7c51012590e2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ded8453182d34898a1ec7c51012590e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ded8453182d34898a1ec7c51012590e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:23:34.685345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-VolumesNegativeTest-1988380099 Sep 20 22:23:34.685345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: ded8453182d34898a1ec7c51012590e2 Sep 20 22:23:34.685345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-VolumesNegativeTest-1988380099 Sep 20 22:23:34.685345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-VolumesNegativeTest-1988380099-project Sep 20 22:23:34.685345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:23:34.685345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:23:34.685345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 59ff4bc2b5c4403dacbaad17d655ab72 Sep 20 22:23:34.685345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-VolumesNegativeTest-1988380099-project Sep 20 22:23:34.685345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Sep 20 22:23:34.685345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-644716831", "metadata": {"Type": "work"}}} Sep 20 22:23:34.685345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: Sep 20 22:23:34.685345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-644716831', 'metadata': {'Type': 'work'}}}} Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise error Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi '#$%' Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:23:34.686154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 20 22:23:34.687454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 20 22:23:34.688595 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 20 22:23:34.688595 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.690312 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5ddfcb39-e12b-4c44-b66e-b00cc94a56a8 tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:23:34.693525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5ddfcb39-e12b-4c44-b66e-b00cc94a56a8 tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.434303 Sep 20 22:23:34.694760 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1156 bytes} [Tue Sep 20 22:23:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1437 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 20 22:23:34.705767 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-934fd059-d995-48bb-9d7e-e0134efdd6e5 tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] Action: 'create', calling method: .version_select at 0x7f24f784edc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-709701253", "metadata": {"Type": "work"}}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-934fd059-d995-48bb-9d7e-e0134efdd6e5 tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] Request method failure captured: Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 119 Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj1lU0LVvjoaiG6zKgfliaZ-0fPa9zb6o6nvC_UsYlSRy6OduqxvdwAhHXuYxfP-rtbN2NtdVtAEyIzrXazm3Z9YlsQt5NcmApGdNPZaZ3uOGDsBrRbnwSXfycnG0Qs7SPjKHEMxJ8mDoLgbhSDj5jhCvxirUciF1jAk1izbbYOIRyo Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: ded8453182d34898a1ec7c51012590e2 Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-VolumesNegativeTest-1988380099 Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:23:34.709898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:23:34.711168 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ded8453182d34898a1ec7c51012590e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ded8453182d34898a1ec7c51012590e2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ded8453182d34898a1ec7c51012590e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ded8453182d34898a1ec7c51012590e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:23:34.711168 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-VolumesNegativeTest-1988380099 Sep 20 22:23:34.711168 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: ded8453182d34898a1ec7c51012590e2 Sep 20 22:23:34.711168 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-VolumesNegativeTest-1988380099 Sep 20 22:23:34.711168 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-VolumesNegativeTest-1988380099-project Sep 20 22:23:34.711168 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:23:34.711168 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:23:34.711168 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 59ff4bc2b5c4403dacbaad17d655ab72 Sep 20 22:23:34.711168 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-VolumesNegativeTest-1988380099-project Sep 20 22:23:34.711168 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Sep 20 22:23:34.711168 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-709701253", "metadata": {"Type": "work"}}} Sep 20 22:23:34.711168 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: Sep 20 22:23:34.711168 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-709701253', 'metadata': {'Type': 'work'}}}} Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise error Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi '0' Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:23:34.711934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 20 22:23:34.713216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 20 22:23:34.714260 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 20 22:23:34.714260 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.717173 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-934fd059-d995-48bb-9d7e-e0134efdd6e5 tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:23:34.718200 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-934fd059-d995-48bb-9d7e-e0134efdd6e5 tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017152 Sep 20 22:23:34.719296 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 2/2] 10.222.0.16 () {60 vars in 1156 bytes} [Tue Sep 20 22:23:34 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 20 22:23:34.729872 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-0a734e64-c7ff-4c0a-b884-ba69fb74d97f tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] Action: 'create', calling method: .version_select at 0x7f24f77061f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1930572187", "metadata": {"Type": "work"}}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-0a734e64-c7ff-4c0a-b884-ba69fb74d97f tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] Request method failure captured: Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 119 Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj1lU0LVvjoaiG6zKgfliaZ-0fPa9zb6o6nvC_UsYlSRy6OduqxvdwAhHXuYxfP-rtbN2NtdVtAEyIzrXazm3Z9YlsQt5NcmApGdNPZaZ3uOGDsBrRbnwSXfycnG0Qs7SPjKHEMxJ8mDoLgbhSDj5jhCvxirUciF1jAk1izbbYOIRyo Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: ded8453182d34898a1ec7c51012590e2 Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-VolumesNegativeTest-1988380099 Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:23:34.734379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:23:34.735718 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ded8453182d34898a1ec7c51012590e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ded8453182d34898a1ec7c51012590e2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ded8453182d34898a1ec7c51012590e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ded8453182d34898a1ec7c51012590e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:23:34.735718 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-VolumesNegativeTest-1988380099 Sep 20 22:23:34.735718 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: ded8453182d34898a1ec7c51012590e2 Sep 20 22:23:34.735718 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-VolumesNegativeTest-1988380099 Sep 20 22:23:34.735718 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-VolumesNegativeTest-1988380099-project Sep 20 22:23:34.735718 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:23:34.735718 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:23:34.735718 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 59ff4bc2b5c4403dacbaad17d655ab72 Sep 20 22:23:34.735718 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-VolumesNegativeTest-1988380099-project Sep 20 22:23:34.735718 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Sep 20 22:23:34.735718 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1930572187", "metadata": {"Type": "work"}}} Sep 20 22:23:34.735718 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: Sep 20 22:23:34.735718 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1930572187', 'metadata': {'Type': 'work'}}}} Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise error Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi '' Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:23:34.736469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 20 22:23:34.737932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 20 22:23:34.741049 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 20 22:23:34.741049 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:34.744046 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-0a734e64-c7ff-4c0a-b884-ba69fb74d97f tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:23:34.745396 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-0a734e64-c7ff-4c0a-b884-ba69fb74d97f tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020605 Sep 20 22:23:34.746627 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 3/3] 10.222.0.16 () {60 vars in 1156 bytes} [Tue Sep 20 22:23:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 20 22:23:34.756733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-189a5e3f-5799-4b2c-ac23-744ba9f761fd tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] Calling method '.version_select at 0x7f24f7706ca0>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:23:36.003072 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-189a5e3f-5799-4b2c-ac23-744ba9f761fd tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] HTTP exception thrown: Volume tempest-invalid-797371120 could not be found. Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-189a5e3f-5799-4b2c-ac23-744ba9f761fd tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] Request method failure captured: Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-797371120 HTTP/1.1 Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj1lU0LVvjoaiG6zKgfliaZ-0fPa9zb6o6nvC_UsYlSRy6OduqxvdwAhHXuYxfP-rtbN2NtdVtAEyIzrXazm3Z9YlsQt5NcmApGdNPZaZ3uOGDsBrRbnwSXfycnG0Qs7SPjKHEMxJ8mDoLgbhSDj5jhCvxirUciF1jAk1izbbYOIRyo Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: ded8453182d34898a1ec7c51012590e2 Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-VolumesNegativeTest-1988380099 Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:23:36.007934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:23:36.009426 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ded8453182d34898a1ec7c51012590e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ded8453182d34898a1ec7c51012590e2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ded8453182d34898a1ec7c51012590e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ded8453182d34898a1ec7c51012590e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:23:36.009426 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-VolumesNegativeTest-1988380099 Sep 20 22:23:36.009426 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: ded8453182d34898a1ec7c51012590e2 Sep 20 22:23:36.009426 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-VolumesNegativeTest-1988380099 Sep 20 22:23:36.009426 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-VolumesNegativeTest-1988380099-project Sep 20 22:23:36.009426 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:23:36.009426 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:23:36.009426 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 59ff4bc2b5c4403dacbaad17d655ab72 Sep 20 22:23:36.009426 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-VolumesNegativeTest-1988380099-project Sep 20 22:23:36.009426 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: Sep 20 22:23:36.009426 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Volume tempest-invalid-797371120 could not be found. Sep 20 22:23:36.009426 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': 'tempest-invalid-797371120'} Sep 20 22:23:36.009426 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-797371120 could not be found. (HTTP 404) (Request-ID: req-4c6e9156-1708-471c-8017-76f0b5725a42) Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:23:36.010521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 20 22:23:36.011864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-797371120 could not be found. Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:23:36.013805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-797371120 could not be found. Sep 20 22:23:36.015203 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.015203 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:23:36.015203 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.015203 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:36.015203 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:23:36.015203 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:23:36.015203 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:23:36.015203 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:23:36.015203 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-797371120 could not be found. Sep 20 22:23:36.015203 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.018757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-189a5e3f-5799-4b2c-ac23-744ba9f761fd tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] Returning 404 to user: Volume tempest-invalid-797371120 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:23:36.018757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-189a5e3f-5799-4b2c-ac23-744ba9f761fd tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-797371120" status: 404 len: 98 microversion: 2.1 time: 1.266363 Sep 20 22:23:36.018757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 4/4] 10.222.0.16 () {58 vars in 1215 bytes} [Tue Sep 20 22:23:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-797371120 => generated 98 bytes in 1267 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 20 22:23:36.047979 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-d4fc41c0-50c3-4e7a-bf20-fc331fb3d05d tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015554 Sep 20 22:23:36.055417 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 5/5] 10.222.0.16 () {58 vars in 1140 bytes} [Tue Sep 20 22:23:36 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 20 22:23:36.069745 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-fb2863ed-4dc4-496d-8360-7096f3b84e30 tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012075 Sep 20 22:23:36.071548 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 6/6] 10.222.0.16 () {58 vars in 1137 bytes} [Tue Sep 20 22:23:36 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 20 22:23:36.091224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5114fbaf-0f17-4ca6-8808-2b7525c965cf tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] Calling method '.version_select at 0x7f24f763c430>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:23:36.224941 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-5114fbaf-0f17-4ca6-8808-2b7525c965cf tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] HTTP exception thrown: Volume abd128b7-aa2d-49f2-be4b-ae0041666309 could not be found. Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5114fbaf-0f17-4ca6-8808-2b7525c965cf tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] Request method failure captured: Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: DELETE /compute/v2.1/os-volumes/abd128b7-aa2d-49f2-be4b-ae0041666309 HTTP/1.1 Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj1lU0LVvjoaiG6zKgfliaZ-0fPa9zb6o6nvC_UsYlSRy6OduqxvdwAhHXuYxfP-rtbN2NtdVtAEyIzrXazm3Z9YlsQt5NcmApGdNPZaZ3uOGDsBrRbnwSXfycnG0Qs7SPjKHEMxJ8mDoLgbhSDj5jhCvxirUciF1jAk1izbbYOIRyo Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: ded8453182d34898a1ec7c51012590e2 Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-VolumesNegativeTest-1988380099 Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:23:36.227047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:23:36.228293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ded8453182d34898a1ec7c51012590e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ded8453182d34898a1ec7c51012590e2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ded8453182d34898a1ec7c51012590e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ded8453182d34898a1ec7c51012590e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:23:36.228293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-VolumesNegativeTest-1988380099 Sep 20 22:23:36.228293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: ded8453182d34898a1ec7c51012590e2 Sep 20 22:23:36.228293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-VolumesNegativeTest-1988380099 Sep 20 22:23:36.228293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-VolumesNegativeTest-1988380099-project Sep 20 22:23:36.228293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:23:36.228293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:23:36.228293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 59ff4bc2b5c4403dacbaad17d655ab72 Sep 20 22:23:36.228293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-VolumesNegativeTest-1988380099-project Sep 20 22:23:36.228293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: Sep 20 22:23:36.228293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Volume abd128b7-aa2d-49f2-be4b-ae0041666309 could not be found. Sep 20 22:23:36.228293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': 'abd128b7-aa2d-49f2-be4b-ae0041666309'} Sep 20 22:23:36.228293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume abd128b7-aa2d-49f2-be4b-ae0041666309 could not be found. (HTTP 404) (Request-ID: req-e9b39af4-c862-4003-a7ff-65521a295041) Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:23:36.229103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 20 22:23:36.232036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume abd128b7-aa2d-49f2-be4b-ae0041666309 could not be found. Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 20 22:23:36.234976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:23:36.242006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume abd128b7-aa2d-49f2-be4b-ae0041666309 could not be found. Sep 20 22:23:36.242006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.242006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:23:36.242006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.242006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:36.242006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:23:36.242006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:23:36.242006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:23:36.242006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:23:36.242006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume abd128b7-aa2d-49f2-be4b-ae0041666309 could not be found. Sep 20 22:23:36.242006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.242006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5114fbaf-0f17-4ca6-8808-2b7525c965cf tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] Returning 404 to user: Volume abd128b7-aa2d-49f2-be4b-ae0041666309 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:23:36.242006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5114fbaf-0f17-4ca6-8808-2b7525c965cf tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/abd128b7-aa2d-49f2-be4b-ae0041666309" status: 404 len: 109 microversion: 2.1 time: 0.147974 Sep 20 22:23:36.242006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 7/7] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 20 22:23:36 2022] DELETE /compute/v2.1/os-volumes/abd128b7-aa2d-49f2-be4b-ae0041666309 => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:23:36.244679 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-06c9a972-b3fe-4a1e-9d78-0fc589d7e5bc tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] Calling method '.version_select at 0x7f24f763c1f0>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:23:36.330855 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-704bbbfe-b43c-4999-8a43-40f42215240c tempest-VolumesGetTestJSON-684626688 tempest-VolumesGetTestJSON-684626688-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.554376 Sep 20 22:23:36.331763 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 1/8] 10.222.0.16 () {60 vars in 1156 bytes} [Tue Sep 20 22:23:32 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3557 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 20 22:23:36.351067 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-fdf744a2-0e74-4ca7-9681-865ef1768ad8 tempest-VolumesGetTestJSON-684626688 tempest-VolumesGetTestJSON-684626688-project] Calling method '.version_select at 0x7f24f7720310>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:23:36.375850 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-06c9a972-b3fe-4a1e-9d78-0fc589d7e5bc tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] HTTP exception thrown: Volume 0849a19b-6eee-4f76-8c73-fc2fa4c1aa0b could not be found. Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-06c9a972-b3fe-4a1e-9d78-0fc589d7e5bc tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] Request method failure captured: Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/os-volumes/0849a19b-6eee-4f76-8c73-fc2fa4c1aa0b HTTP/1.1 Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj1lU0LVvjoaiG6zKgfliaZ-0fPa9zb6o6nvC_UsYlSRy6OduqxvdwAhHXuYxfP-rtbN2NtdVtAEyIzrXazm3Z9YlsQt5NcmApGdNPZaZ3uOGDsBrRbnwSXfycnG0Qs7SPjKHEMxJ8mDoLgbhSDj5jhCvxirUciF1jAk1izbbYOIRyo Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: ded8453182d34898a1ec7c51012590e2 Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-VolumesNegativeTest-1988380099 Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:23:36.377832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:23:36.379085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ded8453182d34898a1ec7c51012590e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ded8453182d34898a1ec7c51012590e2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ded8453182d34898a1ec7c51012590e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ded8453182d34898a1ec7c51012590e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:23:36.379085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-VolumesNegativeTest-1988380099 Sep 20 22:23:36.379085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: ded8453182d34898a1ec7c51012590e2 Sep 20 22:23:36.379085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-VolumesNegativeTest-1988380099 Sep 20 22:23:36.379085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-VolumesNegativeTest-1988380099-project Sep 20 22:23:36.379085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:23:36.379085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:23:36.379085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 59ff4bc2b5c4403dacbaad17d655ab72 Sep 20 22:23:36.379085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-VolumesNegativeTest-1988380099-project Sep 20 22:23:36.379085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: Sep 20 22:23:36.379085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Volume 0849a19b-6eee-4f76-8c73-fc2fa4c1aa0b could not be found. Sep 20 22:23:36.379085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': '0849a19b-6eee-4f76-8c73-fc2fa4c1aa0b'} Sep 20 22:23:36.379085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0849a19b-6eee-4f76-8c73-fc2fa4c1aa0b could not be found. (HTTP 404) (Request-ID: req-9198120d-2151-40d8-919f-0a571f5bfc8e) Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:23:36.379855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 22:23:36.382070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0849a19b-6eee-4f76-8c73-fc2fa4c1aa0b could not be found. Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 20 22:23:36.384709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:23:36.387542 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0849a19b-6eee-4f76-8c73-fc2fa4c1aa0b could not be found. Sep 20 22:23:36.387542 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.387542 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:23:36.387542 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.387542 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:36.387542 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:23:36.387542 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:23:36.387542 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:23:36.387542 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:23:36.387542 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0849a19b-6eee-4f76-8c73-fc2fa4c1aa0b could not be found. Sep 20 22:23:36.387542 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:36.387542 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-06c9a972-b3fe-4a1e-9d78-0fc589d7e5bc tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] Returning 404 to user: Volume 0849a19b-6eee-4f76-8c73-fc2fa4c1aa0b could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:23:36.387542 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-06c9a972-b3fe-4a1e-9d78-0fc589d7e5bc tempest-VolumesNegativeTest-1988380099 tempest-VolumesNegativeTest-1988380099-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0849a19b-6eee-4f76-8c73-fc2fa4c1aa0b" status: 404 len: 109 microversion: 2.1 time: 0.143332 Sep 20 22:23:36.387542 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 8/9] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 20 22:23:36 2022] GET /compute/v2.1/os-volumes/0849a19b-6eee-4f76-8c73-fc2fa4c1aa0b => generated 109 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 22:23:36.508182 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-fdf744a2-0e74-4ca7-9681-865ef1768ad8 tempest-VolumesGetTestJSON-684626688 tempest-VolumesGetTestJSON-684626688-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b9fd301d-21ba-4830-8a2f-65b39a228f7f" status: 200 len: 353 microversion: 2.1 time: 0.165076 Sep 20 22:23:36.508662 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 2/10] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 20 22:23:36 2022] GET /compute/v2.1/os-volumes/b9fd301d-21ba-4830-8a2f-65b39a228f7f => generated 353 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:23:37.523169 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b35a3d96-97a4-4a09-b4b0-2e283a3091db tempest-VolumesGetTestJSON-684626688 tempest-VolumesGetTestJSON-684626688-project] Calling method '.version_select at 0x7f24f770b0d0>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:23:37.663907 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b35a3d96-97a4-4a09-b4b0-2e283a3091db tempest-VolumesGetTestJSON-684626688 tempest-VolumesGetTestJSON-684626688-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b9fd301d-21ba-4830-8a2f-65b39a228f7f" status: 200 len: 354 microversion: 2.1 time: 0.145414 Sep 20 22:23:37.673994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 9/11] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 20 22:23:37 2022] GET /compute/v2.1/os-volumes/b9fd301d-21ba-4830-8a2f-65b39a228f7f => generated 354 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:23:37.678970 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-81e5f2e8-f978-4639-8eec-b62546e73248 tempest-VolumesGetTestJSON-684626688 tempest-VolumesGetTestJSON-684626688-project] Calling method '.version_select at 0x7f24f77209d0>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:23:37.772769 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-81e5f2e8-f978-4639-8eec-b62546e73248 tempest-VolumesGetTestJSON-684626688 tempest-VolumesGetTestJSON-684626688-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b9fd301d-21ba-4830-8a2f-65b39a228f7f" status: 200 len: 354 microversion: 2.1 time: 0.098278 Sep 20 22:23:37.773492 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 3/12] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 20 22:23:37 2022] GET /compute/v2.1/os-volumes/b9fd301d-21ba-4830-8a2f-65b39a228f7f => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:23:37.796828 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4fb9de26-0460-404b-a5d7-ff355796e34b tempest-VolumesGetTestJSON-684626688 tempest-VolumesGetTestJSON-684626688-project] Calling method '.version_select at 0x7f24f763c790>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:23:37.944245 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4fb9de26-0460-404b-a5d7-ff355796e34b tempest-VolumesGetTestJSON-684626688 tempest-VolumesGetTestJSON-684626688-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/b9fd301d-21ba-4830-8a2f-65b39a228f7f" status: 202 len: 0 microversion: 2.1 time: 0.152174 Sep 20 22:23:37.945060 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 10/13] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 20 22:23:37 2022] DELETE /compute/v2.1/os-volumes/b9fd301d-21ba-4830-8a2f-65b39a228f7f => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:23:37.954001 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b606da5c-4609-46f6-b47d-e3d2b7b0f421 tempest-VolumesGetTestJSON-684626688 tempest-VolumesGetTestJSON-684626688-project] Calling method '.version_select at 0x7f24f77300d0>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:23:38.062127 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b606da5c-4609-46f6-b47d-e3d2b7b0f421 tempest-VolumesGetTestJSON-684626688 tempest-VolumesGetTestJSON-684626688-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b9fd301d-21ba-4830-8a2f-65b39a228f7f" status: 200 len: 353 microversion: 2.1 time: 0.112143 Sep 20 22:23:38.063054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 4/14] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 20 22:23:37 2022] GET /compute/v2.1/os-volumes/b9fd301d-21ba-4830-8a2f-65b39a228f7f => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:23:39.079355 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c6117baf-7901-4ee2-b1c1-74d1690f3bda tempest-VolumesGetTestJSON-684626688 tempest-VolumesGetTestJSON-684626688-project] Calling method '.version_select at 0x7f24f763c310>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:23:39.137821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-c6117baf-7901-4ee2-b1c1-74d1690f3bda tempest-VolumesGetTestJSON-684626688 tempest-VolumesGetTestJSON-684626688-project] HTTP exception thrown: Volume b9fd301d-21ba-4830-8a2f-65b39a228f7f could not be found. Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c6117baf-7901-4ee2-b1c1-74d1690f3bda tempest-VolumesGetTestJSON-684626688 tempest-VolumesGetTestJSON-684626688-project] Request method failure captured: Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/os-volumes/b9fd301d-21ba-4830-8a2f-65b39a228f7f HTTP/1.1 Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj1kBAoci2rf6-qovlTe75H8-X-BUf64Xl68U4dSmIDI94xiHc0Jtmj1PqramepLVy76JgoyfGPQdrxNMDds9ODSXbrr60JtjyX10_EtSsST1zaMniUCuixLRjTd0f-UQ-OO7PBSlB4a4fKE8-afVHEY4sdfE3TYkPDKDewX_SpCZJc Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: c6a9342fd3304c5b9102d1e899968753 Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-VolumesGetTestJSON-684626688 Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:23:39.143742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:23:39.144846 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6a9342fd3304c5b9102d1e899968753"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c6a9342fd3304c5b9102d1e899968753", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c6a9342fd3304c5b9102d1e899968753"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6a9342fd3304c5b9102d1e899968753"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:23:39.144846 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-VolumesGetTestJSON-684626688 Sep 20 22:23:39.144846 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: c6a9342fd3304c5b9102d1e899968753 Sep 20 22:23:39.144846 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-VolumesGetTestJSON-684626688 Sep 20 22:23:39.144846 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-VolumesGetTestJSON-684626688-project Sep 20 22:23:39.144846 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:23:39.144846 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:23:39.144846 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 0f1dffaaf9ff4301b5974b26d1f0988e Sep 20 22:23:39.144846 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-VolumesGetTestJSON-684626688-project Sep 20 22:23:39.144846 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: Sep 20 22:23:39.144846 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Volume b9fd301d-21ba-4830-8a2f-65b39a228f7f could not be found. Sep 20 22:23:39.144846 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': 'b9fd301d-21ba-4830-8a2f-65b39a228f7f'} Sep 20 22:23:39.144846 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b9fd301d-21ba-4830-8a2f-65b39a228f7f could not be found. (HTTP 404) (Request-ID: req-58a9810c-90f3-4974-9ca4-3a4eef3e61e0) Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:23:39.146101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 22:23:39.147180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b9fd301d-21ba-4830-8a2f-65b39a228f7f could not be found. Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 20 22:23:39.148132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:23:39.149105 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b9fd301d-21ba-4830-8a2f-65b39a228f7f could not be found. Sep 20 22:23:39.149105 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:39.149105 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:23:39.149105 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:39.149105 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:23:39.149105 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:23:39.149105 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:23:39.149105 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:23:39.149105 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:23:39.149105 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b9fd301d-21ba-4830-8a2f-65b39a228f7f could not be found. Sep 20 22:23:39.149105 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:23:39.151627 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c6117baf-7901-4ee2-b1c1-74d1690f3bda tempest-VolumesGetTestJSON-684626688 tempest-VolumesGetTestJSON-684626688-project] Returning 404 to user: Volume b9fd301d-21ba-4830-8a2f-65b39a228f7f could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:23:39.151627 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c6117baf-7901-4ee2-b1c1-74d1690f3bda tempest-VolumesGetTestJSON-684626688 tempest-VolumesGetTestJSON-684626688-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b9fd301d-21ba-4830-8a2f-65b39a228f7f" status: 404 len: 109 microversion: 2.1 time: 0.078678 Sep 20 22:23:39.151627 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 11/15] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 20 22:23:39 2022] GET /compute/v2.1/os-volumes/b9fd301d-21ba-4830-8a2f-65b39a228f7f => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:23:42.672611 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-76a5c794-150b-4915-8c90-b30298cec7b1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Action: 'create', calling method: .version_select at 0x7f24f7720ee0>, body: {"keypair": {"name": "tempest-keypair-2114063506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJvlNCxeSqfpA1wfkwzGefn0v4coL3nowqVtuzqjQr2rHf3dcXn1NHxW8xp4xg00WSFrqKruCKsYEpf1dVLK42j7mlZGV9iVbkVI+Wh1NsK5JpRit650xJ8DmxBxC20Zw=="}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:23:42.820188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-76a5c794-150b-4915-8c90-b30298cec7b1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Getting quotas for project 02ff885440634a13916a25973bdde7b3. Resources: {'key_pairs'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:23:42.843178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-76a5c794-150b-4915-8c90-b30298cec7b1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Getting quotas for user c45fbc2758e641fba97c0b3096db4f15 and project 02ff885440634a13916a25973bdde7b3. Resources: {'key_pairs'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:23:42.975341 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-76a5c794-150b-4915-8c90-b30298cec7b1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.668996 Sep 20 22:23:42.977607 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 5/16] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 20 22:23:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:23:45.701007 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-741342c5-c983-4873-9976-40f7453d44da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-399603228", "imageRef": "a1be001e-c2e4-44b7-b0d2-af96de3855c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b3cbf78-a136-43a3-9b63-4931c8818134"}], "security_groups": [{"name": "tempest-securitygroup--514867408"}], "key_name": "tempest-keypair-2114063506", "user_data": "}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:23:46.132788 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.network.neutron [None req-741342c5-c983-4873-9976-40f7453d44da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] validate_networks() for [('2b3cbf78-a136-43a3-9b63-4931c8818134', None, None, None, None, None)] {{(pid=120474) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:23:49.455389 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-741342c5-c983-4873-9976-40f7453d44da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Flavor limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:23:49.456759 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-741342c5-c983-4873-9976-40f7453d44da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Image limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:23:49.458052 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-741342c5-c983-4873-9976-40f7453d44da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Flavor pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:23:49.459138 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-741342c5-c983-4873-9976-40f7453d44da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Image pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:23:49.459721 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-741342c5-c983-4873-9976-40f7453d44da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:23:49.494651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-741342c5-c983-4873-9976-40f7453d44da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:23:49.501602 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-741342c5-c983-4873-9976-40f7453d44da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:23:49.503135 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-741342c5-c983-4873-9976-40f7453d44da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:23:49.505252 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-741342c5-c983-4873-9976-40f7453d44da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:23:49.507174 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-741342c5-c983-4873-9976-40f7453d44da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:23:49.508765 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-741342c5-c983-4873-9976-40f7453d44da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:23:49.607000 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-741342c5-c983-4873-9976-40f7453d44da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Getting quotas for project 02ff885440634a13916a25973bdde7b3. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:23:49.626959 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-741342c5-c983-4873-9976-40f7453d44da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Getting quotas for user c45fbc2758e641fba97c0b3096db4f15 and project 02ff885440634a13916a25973bdde7b3. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:23:49.662085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-741342c5-c983-4873-9976-40f7453d44da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Going to run 1 instances... {{(pid=120474) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:23:49.670046 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-741342c5-c983-4873-9976-40f7453d44da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a1be001e-c2e4-44b7-b0d2-af96de3855c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:23:49.897468 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-741342c5-c983-4873-9976-40f7453d44da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.202541 Sep 20 22:23:49.898650 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 12/17] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:23:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 4206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 22:23:49.913997 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-fdc74ba9-acd0-43a2-a67a-e4e234cfefa2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:23:49.917628 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-fdc74ba9-acd0-43a2-a67a-e4e234cfefa2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:23:50.211228 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-fdc74ba9-acd0-43a2-a67a-e4e234cfefa2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:23:50.242241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-fdc74ba9-acd0-43a2-a67a-e4e234cfefa2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1237 microversion: 2.1 time: 0.334223 Sep 20 22:23:50.243444 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 6/18] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:23:49 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1237 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:23:50.655470 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b0baa540-ad93-4362-a199-11e69ea4e040 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-411967478", "imageRef": "a1be001e-c2e4-44b7-b0d2-af96de3855c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:23:50.776918 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.network.neutron [None req-b0baa540-ad93-4362-a199-11e69ea4e040 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] validate_networks() for [('fb96844d-680b-4102-a9cf-bec623bb10c8', None, None, None, None, None)] {{(pid=120474) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:23:51.271495 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-dcf46b1a-da3c-4c6b-abfe-955d1ca216da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:23:51.272112 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-dcf46b1a-da3c-4c6b-abfe-955d1ca216da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:23:51.435246 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-dcf46b1a-da3c-4c6b-abfe-955d1ca216da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:23:51.444582 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-dcf46b1a-da3c-4c6b-abfe-955d1ca216da tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1237 microversion: 2.1 time: 0.176850 Sep 20 22:23:51.457494 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 7/19] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:23:51 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1237 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:23:52.472844 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-1b2102ff-b7e3-4f92-b076-3c23c9e441a9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:23:52.473635 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-1b2102ff-b7e3-4f92-b076-3c23c9e441a9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:23:52.485018 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1b2102ff-b7e3-4f92-b076-3c23c9e441a9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:23:52.491397 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1b2102ff-b7e3-4f92-b076-3c23c9e441a9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:23:52.493223 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1b2102ff-b7e3-4f92-b076-3c23c9e441a9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:23:52.494072 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1b2102ff-b7e3-4f92-b076-3c23c9e441a9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:23:52.496399 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1b2102ff-b7e3-4f92-b076-3c23c9e441a9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:23:52.501503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1b2102ff-b7e3-4f92-b076-3c23c9e441a9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:23:53.362795 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-b0baa540-ad93-4362-a199-11e69ea4e040 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Flavor limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:23:53.363311 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-b0baa540-ad93-4362-a199-11e69ea4e040 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Image limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:23:53.363688 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-b0baa540-ad93-4362-a199-11e69ea4e040 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Flavor pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:23:53.364343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-b0baa540-ad93-4362-a199-11e69ea4e040 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Image pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:23:53.365225 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-b0baa540-ad93-4362-a199-11e69ea4e040 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:23:53.383454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b0baa540-ad93-4362-a199-11e69ea4e040 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:23:53.384124 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b0baa540-ad93-4362-a199-11e69ea4e040 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:23:53.386060 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b0baa540-ad93-4362-a199-11e69ea4e040 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:23:53.387505 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b0baa540-ad93-4362-a199-11e69ea4e040 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:23:53.392488 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b0baa540-ad93-4362-a199-11e69ea4e040 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:23:53.393243 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b0baa540-ad93-4362-a199-11e69ea4e040 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:23:53.476589 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-b0baa540-ad93-4362-a199-11e69ea4e040 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Getting quotas for project e1076a54706448038779945f53703345. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:23:53.488599 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-b0baa540-ad93-4362-a199-11e69ea4e040 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Getting quotas for user 55ab0d396ace494c8884d21d41a04e72 and project e1076a54706448038779945f53703345. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:23:53.516722 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b0baa540-ad93-4362-a199-11e69ea4e040 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Going to run 1 instances... {{(pid=120474) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:23:53.521744 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b0baa540-ad93-4362-a199-11e69ea4e040 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a1be001e-c2e4-44b7-b0d2-af96de3855c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:23:53.658166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b0baa540-ad93-4362-a199-11e69ea4e040 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.354769 Sep 20 22:23:53.665634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 13/20] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:23:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 3365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 22:23:53.684861 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9fd7e10b-d899-4c7b-8580-fd1f3c91cd7c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:23:53.685526 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9fd7e10b-d899-4c7b-8580-fd1f3c91cd7c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:23:53.815716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-1b2102ff-b7e3-4f92-b076-3c23c9e441a9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:23:53.840690 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-1b2102ff-b7e3-4f92-b076-3c23c9e441a9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1241 microversion: 2.1 time: 1.371512 Sep 20 22:23:53.841884 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 8/21] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:23:52 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1241 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:23:54.430688 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-9fd7e10b-d899-4c7b-8580-fd1f3c91cd7c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:23:54.504776 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-9fd7e10b-d899-4c7b-8580-fd1f3c91cd7c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1221 microversion: 2.1 time: 0.825040 Sep 20 22:23:54.505746 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 14/22] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:23:53 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1221 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:23:54.822654 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-2a17c9e7-f2d4-47e3-8386-1e1603f269d6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-789420434", "imageRef": "a1be001e-c2e4-44b7-b0d2-af96de3855c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:23:54.910990 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-f2a7e9d4-1747-4746-814f-86e152b0f0f5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-464272721", "imageRef": "a1be001e-c2e4-44b7-b0d2-af96de3855c4", "flavorRef": "452", "networks": [{"uuid": "28cbe139-2fb4-430b-a584-e2ebae929181"}]}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:23:54.987839 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.network.neutron [None req-2a17c9e7-f2d4-47e3-8386-1e1603f269d6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] validate_networks() for [('fb96844d-680b-4102-a9cf-bec623bb10c8', None, None, None, None, None)] {{(pid=120474) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:23:55.121831 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.network.neutron [None req-f2a7e9d4-1747-4746-814f-86e152b0f0f5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] validate_networks() for [('28cbe139-2fb4-430b-a584-e2ebae929181', None, None, None, None, None)] {{(pid=120473) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:23:56.615165 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-2a17c9e7-f2d4-47e3-8386-1e1603f269d6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Flavor limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:23:56.615722 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-2a17c9e7-f2d4-47e3-8386-1e1603f269d6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Image limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:23:56.616569 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-2a17c9e7-f2d4-47e3-8386-1e1603f269d6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Flavor pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:23:56.617074 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-2a17c9e7-f2d4-47e3-8386-1e1603f269d6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Image pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:23:56.617530 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-2a17c9e7-f2d4-47e3-8386-1e1603f269d6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:23:56.656435 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2a17c9e7-f2d4-47e3-8386-1e1603f269d6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:23:56.656935 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2a17c9e7-f2d4-47e3-8386-1e1603f269d6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:23:56.659650 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2a17c9e7-f2d4-47e3-8386-1e1603f269d6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:23:56.660604 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2a17c9e7-f2d4-47e3-8386-1e1603f269d6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:23:56.662417 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2a17c9e7-f2d4-47e3-8386-1e1603f269d6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:23:56.664953 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2a17c9e7-f2d4-47e3-8386-1e1603f269d6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:23:56.758818 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-2a17c9e7-f2d4-47e3-8386-1e1603f269d6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Getting quotas for project e1076a54706448038779945f53703345. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:23:56.773632 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-2a17c9e7-f2d4-47e3-8386-1e1603f269d6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Getting quotas for user 55ab0d396ace494c8884d21d41a04e72 and project e1076a54706448038779945f53703345. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:23:56.835583 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-2a17c9e7-f2d4-47e3-8386-1e1603f269d6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Going to run 1 instances... {{(pid=120474) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:23:56.837842 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-2a17c9e7-f2d4-47e3-8386-1e1603f269d6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a1be001e-c2e4-44b7-b0d2-af96de3855c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:23:56.984518 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-2a17c9e7-f2d4-47e3-8386-1e1603f269d6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.165367 Sep 20 22:23:56.993323 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 15/23] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:23:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 2170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 20 22:23:56.996008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b4539619-968e-4bca-b7bb-811214c79e8d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:23:57.002250 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b4539619-968e-4bca-b7bb-811214c79e8d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:23:57.010707 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b4539619-968e-4bca-b7bb-811214c79e8d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:23:57.015866 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b4539619-968e-4bca-b7bb-811214c79e8d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:23:57.017443 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b4539619-968e-4bca-b7bb-811214c79e8d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:23:57.020906 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b4539619-968e-4bca-b7bb-811214c79e8d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:23:57.022581 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b4539619-968e-4bca-b7bb-811214c79e8d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:23:57.023173 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b4539619-968e-4bca-b7bb-811214c79e8d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:23:57.807803 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b4539619-968e-4bca-b7bb-811214c79e8d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:23:57.833795 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b4539619-968e-4bca-b7bb-811214c79e8d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1295 microversion: 2.1 time: 0.843448 Sep 20 22:23:57.851030 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 16/24] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:23:56 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1295 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:23:58.128498 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-f2a7e9d4-1747-4746-814f-86e152b0f0f5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Flavor limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:23:58.129544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-f2a7e9d4-1747-4746-814f-86e152b0f0f5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Image limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:23:58.130175 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-f2a7e9d4-1747-4746-814f-86e152b0f0f5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Flavor pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:23:58.130730 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-f2a7e9d4-1747-4746-814f-86e152b0f0f5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Image pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:23:58.131494 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-f2a7e9d4-1747-4746-814f-86e152b0f0f5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:23:58.167497 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f2a7e9d4-1747-4746-814f-86e152b0f0f5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:23:58.171080 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f2a7e9d4-1747-4746-814f-86e152b0f0f5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:23:58.173228 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f2a7e9d4-1747-4746-814f-86e152b0f0f5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:23:58.176424 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f2a7e9d4-1747-4746-814f-86e152b0f0f5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:23:58.177051 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f2a7e9d4-1747-4746-814f-86e152b0f0f5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:23:58.179711 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f2a7e9d4-1747-4746-814f-86e152b0f0f5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:23:58.294935 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-f2a7e9d4-1747-4746-814f-86e152b0f0f5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Getting quotas for project 022e19ae817e4fb9b0eda463455c2ccf. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:23:58.312908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-f2a7e9d4-1747-4746-814f-86e152b0f0f5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Getting quotas for user e9f19d4f5e6243bab3819c7e609f534c and project 022e19ae817e4fb9b0eda463455c2ccf. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:23:58.367164 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-f2a7e9d4-1747-4746-814f-86e152b0f0f5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Going to run 1 instances... {{(pid=120473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:23:58.370028 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-f2a7e9d4-1747-4746-814f-86e152b0f0f5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a1be001e-c2e4-44b7-b0d2-af96de3855c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:23:58.514156 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c92dac61-c973-41be-b4b5-8b674ed1710c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Action: 'create', calling method: .version_select at 0x7f24f6c81310>, body: {"keypair": {"name": "tempest-keypair-1602590608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJbSKcRkcfcJclF1vKkBhH4E0kScm4/81BB81OQPFK9321gFxpD3XB/vIEENgz08EvRi/b7VOCak7TWBHgdTQTzA2237KBoeDYe9pccO67lQAAWBaztVRb3VLi9l/Vh+Q=="}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:23:58.584671 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-f2a7e9d4-1747-4746-814f-86e152b0f0f5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.139936 Sep 20 22:23:58.585507 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 9/25] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:23:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 4142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 22:23:58.616452 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-f1ad7d9a-d861-484d-95b0-d2510d1f01b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:23:58.623420 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-c92dac61-c973-41be-b4b5-8b674ed1710c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Getting quotas for project 897090e72bcc4d978384c95688ab8021. Resources: {'key_pairs'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:23:58.627705 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-f1ad7d9a-d861-484d-95b0-d2510d1f01b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:23:58.640818 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-c92dac61-c973-41be-b4b5-8b674ed1710c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Getting quotas for user 69928e19721a455fb614c6f755495449 and project 897090e72bcc4d978384c95688ab8021. Resources: {'key_pairs'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:23:58.666870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f1ad7d9a-d861-484d-95b0-d2510d1f01b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:23:58.667373 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f1ad7d9a-d861-484d-95b0-d2510d1f01b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:23:58.674471 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f1ad7d9a-d861-484d-95b0-d2510d1f01b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:23:58.677773 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f1ad7d9a-d861-484d-95b0-d2510d1f01b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:23:58.678420 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f1ad7d9a-d861-484d-95b0-d2510d1f01b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:23:58.686773 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f1ad7d9a-d861-484d-95b0-d2510d1f01b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:23:58.821474 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c92dac61-c973-41be-b4b5-8b674ed1710c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.968547 Sep 20 22:23:58.824863 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 17/26] 10.222.0.16 () {62 vars in 1200 bytes} [Tue Sep 20 22:23:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 973 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 20 22:23:58.836618 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4da1d340-a818-44af-a532-b962459e4a9b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:23:58.843711 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4da1d340-a818-44af-a532-b962459e4a9b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:23:59.148950 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f1ad7d9a-d861-484d-95b0-d2510d1f01b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:23:59.165131 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-f1ad7d9a-d861-484d-95b0-d2510d1f01b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1217 microversion: 2.1 time: 0.573237 Sep 20 22:23:59.165934 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 10/27] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:23:58 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1217 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:23:59.212906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ff451088-4d59-49f9-9cea-9be9921ad083 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:23:59.213570 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ff451088-4d59-49f9-9cea-9be9921ad083 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:23:59.243334 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ff451088-4d59-49f9-9cea-9be9921ad083 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:23:59.244070 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ff451088-4d59-49f9-9cea-9be9921ad083 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:23:59.250765 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ff451088-4d59-49f9-9cea-9be9921ad083 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:23:59.251791 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ff451088-4d59-49f9-9cea-9be9921ad083 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:23:59.252449 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ff451088-4d59-49f9-9cea-9be9921ad083 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:23:59.271335 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ff451088-4d59-49f9-9cea-9be9921ad083 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:23:59.288460 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4da1d340-a818-44af-a532-b962459e4a9b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:23:59.310353 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4da1d340-a818-44af-a532-b962459e4a9b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1214 microversion: 2.1 time: 0.481451 Sep 20 22:23:59.315139 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 18/28] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:23:58 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1214 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:23:59.811749 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ff451088-4d59-49f9-9cea-9be9921ad083 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:23:59.834962 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ff451088-4d59-49f9-9cea-9be9921ad083 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1295 microversion: 2.1 time: 0.645540 Sep 20 22:23:59.841141 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 11/29] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:23:59 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1295 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:00.199586 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-2f5acefc-04ec-420f-ac13-6c2f27c2ebe0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:00.201358 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-2f5acefc-04ec-420f-ac13-6c2f27c2ebe0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:00.220608 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2f5acefc-04ec-420f-ac13-6c2f27c2ebe0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:00.221547 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2f5acefc-04ec-420f-ac13-6c2f27c2ebe0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:00.223236 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2f5acefc-04ec-420f-ac13-6c2f27c2ebe0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:00.225586 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2f5acefc-04ec-420f-ac13-6c2f27c2ebe0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:00.226263 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2f5acefc-04ec-420f-ac13-6c2f27c2ebe0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:00.229265 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2f5acefc-04ec-420f-ac13-6c2f27c2ebe0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:00.340775 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a1f7d841-a04c-41b6-88b3-4de687380931 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:00.341503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a1f7d841-a04c-41b6-88b3-4de687380931 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:00.364301 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a1f7d841-a04c-41b6-88b3-4de687380931 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:00.372236 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a1f7d841-a04c-41b6-88b3-4de687380931 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:00.372777 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a1f7d841-a04c-41b6-88b3-4de687380931 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:00.373615 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a1f7d841-a04c-41b6-88b3-4de687380931 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:00.376435 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a1f7d841-a04c-41b6-88b3-4de687380931 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:00.381409 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a1f7d841-a04c-41b6-88b3-4de687380931 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:00.635287 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a1f7d841-a04c-41b6-88b3-4de687380931 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:00.654439 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a1f7d841-a04c-41b6-88b3-4de687380931 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1218 microversion: 2.1 time: 0.318183 Sep 20 22:24:00.655629 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 12/30] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:00 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1218 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:00.862332 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-2b67998e-d0ec-4fc3-b24d-49bc993d546b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:00.863392 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-2b67998e-d0ec-4fc3-b24d-49bc993d546b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:00.884126 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2b67998e-d0ec-4fc3-b24d-49bc993d546b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:00.885358 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2b67998e-d0ec-4fc3-b24d-49bc993d546b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:00.886852 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2b67998e-d0ec-4fc3-b24d-49bc993d546b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:00.894422 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2b67998e-d0ec-4fc3-b24d-49bc993d546b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:00.895205 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2b67998e-d0ec-4fc3-b24d-49bc993d546b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:00.895932 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2b67998e-d0ec-4fc3-b24d-49bc993d546b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:00.957865 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-2f5acefc-04ec-420f-ac13-6c2f27c2ebe0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:00.968706 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-2f5acefc-04ec-420f-ac13-6c2f27c2ebe0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1279 microversion: 2.1 time: 0.775275 Sep 20 22:24:00.982580 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 19/31] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:00 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1279 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:01.687104 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3f6c881b-de83-44f1-8b67-d81150949aea tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:01.688536 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-3f6c881b-de83-44f1-8b67-d81150949aea tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:01.693268 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-2b67998e-d0ec-4fc3-b24d-49bc993d546b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:01.701999 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-2b67998e-d0ec-4fc3-b24d-49bc993d546b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1295 microversion: 2.1 time: 0.843946 Sep 20 22:24:01.702477 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 13/32] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:00 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1295 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:01.729038 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3f6c881b-de83-44f1-8b67-d81150949aea tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:01.733128 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3f6c881b-de83-44f1-8b67-d81150949aea tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:01.737687 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3f6c881b-de83-44f1-8b67-d81150949aea tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:01.742051 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3f6c881b-de83-44f1-8b67-d81150949aea tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:01.748887 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3f6c881b-de83-44f1-8b67-d81150949aea tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:01.749744 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3f6c881b-de83-44f1-8b67-d81150949aea tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:02.010479 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0aa0d922-e6f2-49a7-ab77-878b5001c28d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:02.011184 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-0aa0d922-e6f2-49a7-ab77-878b5001c28d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:02.035450 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0aa0d922-e6f2-49a7-ab77-878b5001c28d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:02.039036 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0aa0d922-e6f2-49a7-ab77-878b5001c28d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:02.039767 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0aa0d922-e6f2-49a7-ab77-878b5001c28d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:02.043594 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0aa0d922-e6f2-49a7-ab77-878b5001c28d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:02.044949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0aa0d922-e6f2-49a7-ab77-878b5001c28d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:02.049862 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0aa0d922-e6f2-49a7-ab77-878b5001c28d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:02.450618 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-0aa0d922-e6f2-49a7-ab77-878b5001c28d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:02.458515 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-0aa0d922-e6f2-49a7-ab77-878b5001c28d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1279 microversion: 2.1 time: 0.452040 Sep 20 22:24:02.463254 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 14/33] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:02 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1279 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:02.555430 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3f6c881b-de83-44f1-8b67-d81150949aea tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:02.579674 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-3f6c881b-de83-44f1-8b67-d81150949aea tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1266 microversion: 2.1 time: 0.897720 Sep 20 22:24:02.580446 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 20/34] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:01 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1266 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:02.727827 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-7035319e-5081-4374-a032-dbe221080748 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:02.728514 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-7035319e-5081-4374-a032-dbe221080748 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:02.759433 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7035319e-5081-4374-a032-dbe221080748 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:02.763107 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7035319e-5081-4374-a032-dbe221080748 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:02.764214 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7035319e-5081-4374-a032-dbe221080748 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:02.771443 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7035319e-5081-4374-a032-dbe221080748 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:02.776697 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7035319e-5081-4374-a032-dbe221080748 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:02.777406 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7035319e-5081-4374-a032-dbe221080748 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:03.271789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-7035319e-5081-4374-a032-dbe221080748 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:03.285694 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-7035319e-5081-4374-a032-dbe221080748 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1295 microversion: 2.1 time: 0.563215 Sep 20 22:24:03.302814 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 15/35] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:02 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1295 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:03.482119 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-04781237-30ca-4c0f-8c5c-18f70229eab0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:03.482737 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-04781237-30ca-4c0f-8c5c-18f70229eab0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:03.515748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-04781237-30ca-4c0f-8c5c-18f70229eab0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:03.521658 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-04781237-30ca-4c0f-8c5c-18f70229eab0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:03.522738 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-04781237-30ca-4c0f-8c5c-18f70229eab0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:03.526301 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-04781237-30ca-4c0f-8c5c-18f70229eab0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:03.528451 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-04781237-30ca-4c0f-8c5c-18f70229eab0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:03.532052 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-04781237-30ca-4c0f-8c5c-18f70229eab0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:03.610912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-26797ced-3784-4dd5-bcbd-0a9baeebe6f8 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:03.611537 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-26797ced-3784-4dd5-bcbd-0a9baeebe6f8 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:03.620318 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:03.623125 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-26797ced-3784-4dd5-bcbd-0a9baeebe6f8 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:03.624372 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-26797ced-3784-4dd5-bcbd-0a9baeebe6f8 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:03.627938 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-26797ced-3784-4dd5-bcbd-0a9baeebe6f8 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:03.628828 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-26797ced-3784-4dd5-bcbd-0a9baeebe6f8 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:03.629464 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-26797ced-3784-4dd5-bcbd-0a9baeebe6f8 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:03.630709 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-26797ced-3784-4dd5-bcbd-0a9baeebe6f8 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:03.889614 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-04781237-30ca-4c0f-8c5c-18f70229eab0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:03.900655 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-04781237-30ca-4c0f-8c5c-18f70229eab0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1279 microversion: 2.1 time: 0.423029 Sep 20 22:24:03.906419 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 21/36] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:03 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1279 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:03.988775 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-26797ced-3784-4dd5-bcbd-0a9baeebe6f8 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:04.046634 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-26797ced-3784-4dd5-bcbd-0a9baeebe6f8 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1272 microversion: 2.1 time: 0.423046 Sep 20 22:24:04.047360 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 16/37] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:03 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1272 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:04.319813 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b3af1307-d216-4740-9b1c-fd78e09ed95c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:04.320565 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b3af1307-d216-4740-9b1c-fd78e09ed95c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:04.350730 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b3af1307-d216-4740-9b1c-fd78e09ed95c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:04.351413 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b3af1307-d216-4740-9b1c-fd78e09ed95c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:04.364224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b3af1307-d216-4740-9b1c-fd78e09ed95c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:04.366755 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b3af1307-d216-4740-9b1c-fd78e09ed95c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:04.367318 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b3af1307-d216-4740-9b1c-fd78e09ed95c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:04.369654 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b3af1307-d216-4740-9b1c-fd78e09ed95c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:04.924709 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6aa9a861-f5f2-41fb-b152-ffa4a3ba0171 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:04.925759 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-6aa9a861-f5f2-41fb-b152-ffa4a3ba0171 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:04.961962 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6aa9a861-f5f2-41fb-b152-ffa4a3ba0171 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:04.962487 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6aa9a861-f5f2-41fb-b152-ffa4a3ba0171 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:04.969948 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6aa9a861-f5f2-41fb-b152-ffa4a3ba0171 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:04.973024 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6aa9a861-f5f2-41fb-b152-ffa4a3ba0171 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:04.973532 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6aa9a861-f5f2-41fb-b152-ffa4a3ba0171 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:04.982527 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6aa9a861-f5f2-41fb-b152-ffa4a3ba0171 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:05.395739 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-6aa9a861-f5f2-41fb-b152-ffa4a3ba0171 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:05.420766 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-6aa9a861-f5f2-41fb-b152-ffa4a3ba0171 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1279 microversion: 2.1 time: 0.500043 Sep 20 22:24:05.426447 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 17/38] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:04 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1279 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:05.456751 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d92edc32-4b15-494a-a1c7-9c3db7816bce tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:05.458164 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d92edc32-4b15-494a-a1c7-9c3db7816bce tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:05.518416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d92edc32-4b15-494a-a1c7-9c3db7816bce tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:05.519028 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d92edc32-4b15-494a-a1c7-9c3db7816bce tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:05.519490 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d92edc32-4b15-494a-a1c7-9c3db7816bce tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:05.528696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d92edc32-4b15-494a-a1c7-9c3db7816bce tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:05.532707 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d92edc32-4b15-494a-a1c7-9c3db7816bce tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:05.545342 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d92edc32-4b15-494a-a1c7-9c3db7816bce tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:06.111921 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b3af1307-d216-4740-9b1c-fd78e09ed95c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:06.129310 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b3af1307-d216-4740-9b1c-fd78e09ed95c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 1.814698 Sep 20 22:24:06.130190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 22/39] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:04 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:06.290384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-d92edc32-4b15-494a-a1c7-9c3db7816bce tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:06.305190 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-d92edc32-4b15-494a-a1c7-9c3db7816bce tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1272 microversion: 2.1 time: 0.872921 Sep 20 22:24:06.318254 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 18/40] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:05 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1272 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:06.456574 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-0085dd3c-b93f-4eb1-9041-f8c5a86241df tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:06.457251 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-0085dd3c-b93f-4eb1-9041-f8c5a86241df tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:06.463200 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0085dd3c-b93f-4eb1-9041-f8c5a86241df tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:06.463694 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0085dd3c-b93f-4eb1-9041-f8c5a86241df tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:06.464137 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0085dd3c-b93f-4eb1-9041-f8c5a86241df tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:06.481673 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0085dd3c-b93f-4eb1-9041-f8c5a86241df tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:06.482281 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0085dd3c-b93f-4eb1-9041-f8c5a86241df tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:06.482735 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0085dd3c-b93f-4eb1-9041-f8c5a86241df tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:06.719692 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=6 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:07.154407 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c5a487bd-d6bf-41d4-b01a-9c637b262c55 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:07.155033 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c5a487bd-d6bf-41d4-b01a-9c637b262c55 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:07.168288 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c5a487bd-d6bf-41d4-b01a-9c637b262c55 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:07.169081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c5a487bd-d6bf-41d4-b01a-9c637b262c55 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:07.169532 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c5a487bd-d6bf-41d4-b01a-9c637b262c55 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:07.170248 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c5a487bd-d6bf-41d4-b01a-9c637b262c55 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:07.170729 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c5a487bd-d6bf-41d4-b01a-9c637b262c55 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:07.171129 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c5a487bd-d6bf-41d4-b01a-9c637b262c55 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:08.247389 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=2 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:08.339664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=14 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:09.106214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-0085dd3c-b93f-4eb1-9041-f8c5a86241df tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:09.119191 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-0085dd3c-b93f-4eb1-9041-f8c5a86241df tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 2.663989 Sep 20 22:24:09.136690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 23/41] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:06 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 2685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:09.158085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-48b61391-dd02-47d8-8c4d-3a716f67ff44 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:09.159089 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-48b61391-dd02-47d8-8c4d-3a716f67ff44 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:09.178138 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-48b61391-dd02-47d8-8c4d-3a716f67ff44 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:09.178671 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-48b61391-dd02-47d8-8c4d-3a716f67ff44 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:09.184148 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-48b61391-dd02-47d8-8c4d-3a716f67ff44 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:09.187317 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-48b61391-dd02-47d8-8c4d-3a716f67ff44 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:09.193591 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-48b61391-dd02-47d8-8c4d-3a716f67ff44 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:09.194206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-48b61391-dd02-47d8-8c4d-3a716f67ff44 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:09.305448 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=26 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:09.599921 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c5a487bd-d6bf-41d4-b01a-9c637b262c55 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:09.621203 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-c5a487bd-d6bf-41d4-b01a-9c637b262c55 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 2.463755 Sep 20 22:24:09.623081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 19/42] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:07 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 2474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:10.143554 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-30f7829b-3d26-48dc-9cb8-ff2e800531c5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:10.144340 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-30f7829b-3d26-48dc-9cb8-ff2e800531c5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:10.158184 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30f7829b-3d26-48dc-9cb8-ff2e800531c5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:10.159153 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30f7829b-3d26-48dc-9cb8-ff2e800531c5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:10.159822 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30f7829b-3d26-48dc-9cb8-ff2e800531c5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:10.160777 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30f7829b-3d26-48dc-9cb8-ff2e800531c5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:10.161502 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30f7829b-3d26-48dc-9cb8-ff2e800531c5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:10.162144 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30f7829b-3d26-48dc-9cb8-ff2e800531c5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:10.871480 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-48b61391-dd02-47d8-8c4d-3a716f67ff44 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:10.896327 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-48b61391-dd02-47d8-8c4d-3a716f67ff44 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 1.756954 Sep 20 22:24:10.896868 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 24/43] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:09 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:11.274591 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-1149718f-ffe7-4952-899f-d2c5b800ac79 req-07bb359c-200d-40c5-9337-0f190c2fc01a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b72562d-a97c-4822-bb23-f96a857ce91e", "tag": "2935ce4a-cc6e-475c-a649-2b15aa333949"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:24:11.300368 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-1149718f-ffe7-4952-899f-d2c5b800ac79 req-07bb359c-200d-40c5-9337-0f190c2fc01a service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:11.301164 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-1149718f-ffe7-4952-899f-d2c5b800ac79 req-07bb359c-200d-40c5-9337-0f190c2fc01a service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:11.301744 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-1149718f-ffe7-4952-899f-d2c5b800ac79 req-07bb359c-200d-40c5-9337-0f190c2fc01a service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:11.341259 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-1149718f-ffe7-4952-899f-d2c5b800ac79 req-07bb359c-200d-40c5-9337-0f190c2fc01a service nova] Creating event network-changed:2935ce4a-cc6e-475c-a649-2b15aa333949 for instance 7b72562d-a97c-4822-bb23-f96a857ce91e on hv-cinder-85827 Sep 20 22:24:11.341819 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-1149718f-ffe7-4952-899f-d2c5b800ac79 req-07bb359c-200d-40c5-9337-0f190c2fc01a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 20 22:24:11.342163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-1149718f-ffe7-4952-899f-d2c5b800ac79 req-07bb359c-200d-40c5-9337-0f190c2fc01a service nova] Acquired lock "compute-rpcapi-router" {{(pid=120474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 20 22:24:11.343199 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bffee48c-c390-4cbb-a4e3-dc442cedaa09 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:11.343661 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bffee48c-c390-4cbb-a4e3-dc442cedaa09 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:11.344086 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bffee48c-c390-4cbb-a4e3-dc442cedaa09 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:11.344793 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bffee48c-c390-4cbb-a4e3-dc442cedaa09 None None] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:11.357440 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bffee48c-c390-4cbb-a4e3-dc442cedaa09 None None] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:11.358121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bffee48c-c390-4cbb-a4e3-dc442cedaa09 None None] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:11.378089 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.compute.rpcapi [None req-bffee48c-c390-4cbb-a4e3-dc442cedaa09 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 20 22:24:11.383510 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bffee48c-c390-4cbb-a4e3-dc442cedaa09 None None] Releasing lock "compute-rpcapi-router" {{(pid=120474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 20 22:24:11.421485 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-bffee48c-c390-4cbb-a4e3-dc442cedaa09 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.523317 Sep 20 22:24:11.422440 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 25/44] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:24:11.427586 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5882c089-8ca2-4f58-b237-10d82e7bc3eb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:11.428284 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5882c089-8ca2-4f58-b237-10d82e7bc3eb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:11.445988 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5882c089-8ca2-4f58-b237-10d82e7bc3eb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:11.446771 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5882c089-8ca2-4f58-b237-10d82e7bc3eb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:11.447385 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5882c089-8ca2-4f58-b237-10d82e7bc3eb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:11.449044 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5882c089-8ca2-4f58-b237-10d82e7bc3eb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:11.449957 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5882c089-8ca2-4f58-b237-10d82e7bc3eb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:11.451870 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5882c089-8ca2-4f58-b237-10d82e7bc3eb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:11.670312 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-30f7829b-3d26-48dc-9cb8-ff2e800531c5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:11.678417 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-30f7829b-3d26-48dc-9cb8-ff2e800531c5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 1.538933 Sep 20 22:24:11.682504 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 20/45] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:10 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:11.810428 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b7c8ee1e-7b5e-4315-afd6-d929b6192994 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1423536469", "imageRef": "a1be001e-c2e4-44b7-b0d2-af96de3855c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "281a7f2f-13d6-4f53-b28b-ee8d71863530"}], "security_groups": [{"name": "tempest-securitygroup--525563317"}], "key_name": "tempest-keypair-1602590608", "user_data": "}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:24:12.185596 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.network.neutron [None req-b7c8ee1e-7b5e-4315-afd6-d929b6192994 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] validate_networks() for [('281a7f2f-13d6-4f53-b28b-ee8d71863530', None, None, None, None, None)] {{(pid=120473) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:24:12.259010 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-5882c089-8ca2-4f58-b237-10d82e7bc3eb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:12.274830 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5882c089-8ca2-4f58-b237-10d82e7bc3eb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 0.851200 Sep 20 22:24:12.277857 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 26/46] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:11 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:12.294937 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-cf5b1774-d322-4a52-b196-84388208b9b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:12.300657 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-cf5b1774-d322-4a52-b196-84388208b9b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:12.312011 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cf5b1774-d322-4a52-b196-84388208b9b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:12.313660 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cf5b1774-d322-4a52-b196-84388208b9b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:12.314435 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cf5b1774-d322-4a52-b196-84388208b9b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:12.316684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cf5b1774-d322-4a52-b196-84388208b9b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:12.318141 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cf5b1774-d322-4a52-b196-84388208b9b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:12.319352 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cf5b1774-d322-4a52-b196-84388208b9b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:13.101886 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-cf5b1774-d322-4a52-b196-84388208b9b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:13.114321 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-cf5b1774-d322-4a52-b196-84388208b9b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.829606 Sep 20 22:24:13.114321 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 27/47] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:12 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:13.127498 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-796baca0-fdb6-4fed-b6b7-8fda1ad34a24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:13.128323 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-796baca0-fdb6-4fed-b6b7-8fda1ad34a24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:13.156263 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-796baca0-fdb6-4fed-b6b7-8fda1ad34a24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:13.157850 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-796baca0-fdb6-4fed-b6b7-8fda1ad34a24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:13.158514 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-796baca0-fdb6-4fed-b6b7-8fda1ad34a24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:13.178849 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-796baca0-fdb6-4fed-b6b7-8fda1ad34a24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:13.179404 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-796baca0-fdb6-4fed-b6b7-8fda1ad34a24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:13.179911 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-796baca0-fdb6-4fed-b6b7-8fda1ad34a24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:14.157698 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-b7c8ee1e-7b5e-4315-afd6-d929b6192994 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Flavor limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:24:14.158244 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-b7c8ee1e-7b5e-4315-afd6-d929b6192994 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Image limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:24:14.158827 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-b7c8ee1e-7b5e-4315-afd6-d929b6192994 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Flavor pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:24:14.159451 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-b7c8ee1e-7b5e-4315-afd6-d929b6192994 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Image pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:24:14.160123 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-b7c8ee1e-7b5e-4315-afd6-d929b6192994 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:24:14.174133 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b7c8ee1e-7b5e-4315-afd6-d929b6192994 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:14.176508 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b7c8ee1e-7b5e-4315-afd6-d929b6192994 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:14.177494 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b7c8ee1e-7b5e-4315-afd6-d929b6192994 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:14.179396 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b7c8ee1e-7b5e-4315-afd6-d929b6192994 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:14.179396 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b7c8ee1e-7b5e-4315-afd6-d929b6192994 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:14.181201 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b7c8ee1e-7b5e-4315-afd6-d929b6192994 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:14.198392 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=75 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:14.209862 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-796baca0-fdb6-4fed-b6b7-8fda1ad34a24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:14.224628 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-796baca0-fdb6-4fed-b6b7-8fda1ad34a24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 1.109605 Sep 20 22:24:14.226286 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 28/48] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:13 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:14.238686 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-947c33ae-bb7d-4d07-aca2-fe3461920261 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:14.240799 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-947c33ae-bb7d-4d07-aca2-fe3461920261 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:14.255212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-947c33ae-bb7d-4d07-aca2-fe3461920261 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:14.257831 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-947c33ae-bb7d-4d07-aca2-fe3461920261 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:14.258952 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-947c33ae-bb7d-4d07-aca2-fe3461920261 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:14.259613 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-b7c8ee1e-7b5e-4315-afd6-d929b6192994 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Getting quotas for project 897090e72bcc4d978384c95688ab8021. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:24:14.262967 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-947c33ae-bb7d-4d07-aca2-fe3461920261 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:14.264020 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-947c33ae-bb7d-4d07-aca2-fe3461920261 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:14.265343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-947c33ae-bb7d-4d07-aca2-fe3461920261 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:14.270840 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-b7c8ee1e-7b5e-4315-afd6-d929b6192994 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Getting quotas for user 69928e19721a455fb614c6f755495449 and project 897090e72bcc4d978384c95688ab8021. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:24:14.299689 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b7c8ee1e-7b5e-4315-afd6-d929b6192994 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Going to run 1 instances... {{(pid=120473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:24:14.305444 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b7c8ee1e-7b5e-4315-afd6-d929b6192994 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a1be001e-c2e4-44b7-b0d2-af96de3855c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:24:14.380930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b7c8ee1e-7b5e-4315-afd6-d929b6192994 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.575761 Sep 20 22:24:14.382281 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 21/49] 10.222.0.16 () {62 vars in 1188 bytes} [Tue Sep 20 22:24:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 2579 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 20 22:24:14.389251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-9ce98716-6174-408c-9f16-0ef7f4a2ea47 req-7ef34d68-14f6-4e0e-9b41-0765b9d24b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89747cc8-0eba-4b3b-8fec-ec0663bc51d0", "tag": "beceeb78-fe70-47d6-98db-538612768bf8"}, {"name": "network-changed", "server_uuid": "bfc70c4c-17f0-432f-a168-0e8a0cfadf49", "tag": "a021146d-28cd-4ea4-a592-2293bed5bd15"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:24:14.407477 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-9ce98716-6174-408c-9f16-0ef7f4a2ea47 req-7ef34d68-14f6-4e0e-9b41-0765b9d24b10 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:14.408293 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-9ce98716-6174-408c-9f16-0ef7f4a2ea47 req-7ef34d68-14f6-4e0e-9b41-0765b9d24b10 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:14.409245 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-9ce98716-6174-408c-9f16-0ef7f4a2ea47 req-7ef34d68-14f6-4e0e-9b41-0765b9d24b10 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:14.447176 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-9ce98716-6174-408c-9f16-0ef7f4a2ea47 req-7ef34d68-14f6-4e0e-9b41-0765b9d24b10 service nova] Creating event network-changed:beceeb78-fe70-47d6-98db-538612768bf8 for instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 on hv-cinder-85827 Sep 20 22:24:14.447887 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-9ce98716-6174-408c-9f16-0ef7f4a2ea47 req-7ef34d68-14f6-4e0e-9b41-0765b9d24b10 service nova] Creating event network-changed:a021146d-28cd-4ea4-a592-2293bed5bd15 for instance bfc70c4c-17f0-432f-a168-0e8a0cfadf49 on hv-cinder-85827 Sep 20 22:24:14.449158 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-9ce98716-6174-408c-9f16-0ef7f4a2ea47 req-7ef34d68-14f6-4e0e-9b41-0765b9d24b10 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120473) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 20 22:24:14.449708 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-9ce98716-6174-408c-9f16-0ef7f4a2ea47 req-7ef34d68-14f6-4e0e-9b41-0765b9d24b10 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120473) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 20 22:24:14.450907 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3230bb42-60f1-4df8-853d-42f62aac4ce0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:14.451705 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3230bb42-60f1-4df8-853d-42f62aac4ce0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:14.452299 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3230bb42-60f1-4df8-853d-42f62aac4ce0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:14.453207 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3230bb42-60f1-4df8-853d-42f62aac4ce0 None None] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:14.453967 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3230bb42-60f1-4df8-853d-42f62aac4ce0 None None] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:14.455228 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3230bb42-60f1-4df8-853d-42f62aac4ce0 None None] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:14.466521 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.compute.rpcapi [None req-3230bb42-60f1-4df8-853d-42f62aac4ce0 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 20 22:24:14.468186 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3230bb42-60f1-4df8-853d-42f62aac4ce0 None None] Releasing lock "compute-rpcapi-router" {{(pid=120473) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 20 22:24:14.489991 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-3230bb42-60f1-4df8-853d-42f62aac4ce0 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.105835 Sep 20 22:24:14.491329 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 22/50] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:24:14.498491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-da6e877a-c2c1-4871-99da-3e1ae36947cc tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:14.500639 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-da6e877a-c2c1-4871-99da-3e1ae36947cc tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:14.510582 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-da6e877a-c2c1-4871-99da-3e1ae36947cc tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:14.512096 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-da6e877a-c2c1-4871-99da-3e1ae36947cc tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:14.513401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-da6e877a-c2c1-4871-99da-3e1ae36947cc tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:14.514365 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-da6e877a-c2c1-4871-99da-3e1ae36947cc tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:14.515050 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-da6e877a-c2c1-4871-99da-3e1ae36947cc tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:14.515686 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-da6e877a-c2c1-4871-99da-3e1ae36947cc tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:14.576951 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-947c33ae-bb7d-4d07-aca2-fe3461920261 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:14.587593 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-947c33ae-bb7d-4d07-aca2-fe3461920261 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 0.359982 Sep 20 22:24:14.589110 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 29/51] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:14 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:14.774674 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-da6e877a-c2c1-4871-99da-3e1ae36947cc tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:14.788786 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-da6e877a-c2c1-4871-99da-3e1ae36947cc tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.293964 Sep 20 22:24:14.789651 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 23/52] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:14 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:14.808569 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-54023f65-2e15-46e9-80fb-b4dab5f92c35 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:14.809221 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-54023f65-2e15-46e9-80fb-b4dab5f92c35 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:14.838342 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-5a7c1482-3c48-4ba0-87ed-2bef96c40fc2 req-ba47f72c-f8fb-46ac-bf0f-e93b557d738a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84071376-3176-4365-9249-7554ed26b308", "tag": "032c0f23-cc75-43ef-9989-eed48c7216a2"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:24:14.857521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-5a7c1482-3c48-4ba0-87ed-2bef96c40fc2 req-ba47f72c-f8fb-46ac-bf0f-e93b557d738a service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:14.858011 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-5a7c1482-3c48-4ba0-87ed-2bef96c40fc2 req-ba47f72c-f8fb-46ac-bf0f-e93b557d738a service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:14.858593 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-5a7c1482-3c48-4ba0-87ed-2bef96c40fc2 req-ba47f72c-f8fb-46ac-bf0f-e93b557d738a service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:14.875293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-5a7c1482-3c48-4ba0-87ed-2bef96c40fc2 req-ba47f72c-f8fb-46ac-bf0f-e93b557d738a service nova] Creating event network-changed:032c0f23-cc75-43ef-9989-eed48c7216a2 for instance 84071376-3176-4365-9249-7554ed26b308 on hv-cinder-85827 Sep 20 22:24:14.881761 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-5a7c1482-3c48-4ba0-87ed-2bef96c40fc2 req-ba47f72c-f8fb-46ac-bf0f-e93b557d738a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.290839 Sep 20 22:24:14.883112 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 30/53] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:24:14.896702 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-54023f65-2e15-46e9-80fb-b4dab5f92c35 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:14.905530 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-54023f65-2e15-46e9-80fb-b4dab5f92c35 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:14.907025 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-54023f65-2e15-46e9-80fb-b4dab5f92c35 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:14.908172 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-54023f65-2e15-46e9-80fb-b4dab5f92c35 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1282 microversion: 2.20 time: 0.109086 Sep 20 22:24:14.908739 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 24/54] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:14 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1282 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:15.260047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-48a9585f-a4c7-405f-a8b9-43abd0ca4129 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:15.260813 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-48a9585f-a4c7-405f-a8b9-43abd0ca4129 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:15.268270 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-48a9585f-a4c7-405f-a8b9-43abd0ca4129 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:15.268827 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-48a9585f-a4c7-405f-a8b9-43abd0ca4129 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:15.269339 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-48a9585f-a4c7-405f-a8b9-43abd0ca4129 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:15.270058 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-48a9585f-a4c7-405f-a8b9-43abd0ca4129 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:15.270512 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-48a9585f-a4c7-405f-a8b9-43abd0ca4129 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:15.270931 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-48a9585f-a4c7-405f-a8b9-43abd0ca4129 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:15.462327 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-48a9585f-a4c7-405f-a8b9-43abd0ca4129 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:15.471094 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-48a9585f-a4c7-405f-a8b9-43abd0ca4129 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 0.220901 Sep 20 22:24:15.472254 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 31/55] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:15 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:15.617044 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d192910a-beee-4d56-b661-0cf801c4cb12 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:15.618265 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d192910a-beee-4d56-b661-0cf801c4cb12 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:15.627436 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d192910a-beee-4d56-b661-0cf801c4cb12 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:15.628752 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d192910a-beee-4d56-b661-0cf801c4cb12 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:15.630103 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d192910a-beee-4d56-b661-0cf801c4cb12 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:15.632686 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d192910a-beee-4d56-b661-0cf801c4cb12 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:15.635270 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d192910a-beee-4d56-b661-0cf801c4cb12 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:15.650394 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d192910a-beee-4d56-b661-0cf801c4cb12 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:15.812734 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a2acb638-943a-41c8-b075-ca2ad3a320f9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:15.814078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a2acb638-943a-41c8-b075-ca2ad3a320f9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:15.822452 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:15.824126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a2acb638-943a-41c8-b075-ca2ad3a320f9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:15.824705 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a2acb638-943a-41c8-b075-ca2ad3a320f9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:15.825836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a2acb638-943a-41c8-b075-ca2ad3a320f9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:15.826902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a2acb638-943a-41c8-b075-ca2ad3a320f9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:15.827440 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a2acb638-943a-41c8-b075-ca2ad3a320f9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:15.827869 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a2acb638-943a-41c8-b075-ca2ad3a320f9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:15.851871 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=85 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:15.860496 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-d192910a-beee-4d56-b661-0cf801c4cb12 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:15.877485 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-d192910a-beee-4d56-b661-0cf801c4cb12 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 0.268839 Sep 20 22:24:15.878849 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 25/56] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:15 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:15.934939 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-5f28778e-37fd-46f7-b041-33298dd02cbe tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:15.936396 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-5f28778e-37fd-46f7-b041-33298dd02cbe tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:15.945384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5f28778e-37fd-46f7-b041-33298dd02cbe tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:15.946156 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5f28778e-37fd-46f7-b041-33298dd02cbe tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:15.948142 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5f28778e-37fd-46f7-b041-33298dd02cbe tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:15.949717 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5f28778e-37fd-46f7-b041-33298dd02cbe tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:15.950674 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5f28778e-37fd-46f7-b041-33298dd02cbe tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:15.951182 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5f28778e-37fd-46f7-b041-33298dd02cbe tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:15.981989 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a2acb638-943a-41c8-b075-ca2ad3a320f9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:15.990212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a2acb638-943a-41c8-b075-ca2ad3a320f9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.182066 Sep 20 22:24:15.991007 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 32/57] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:15 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:16.035483 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-5f28778e-37fd-46f7-b041-33298dd02cbe tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:16.045676 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-5f28778e-37fd-46f7-b041-33298dd02cbe tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:16.047543 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-5f28778e-37fd-46f7-b041-33298dd02cbe tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:16.048906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-5f28778e-37fd-46f7-b041-33298dd02cbe tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1286 microversion: 2.20 time: 0.118701 Sep 20 22:24:16.049727 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 26/58] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:15 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:16.494700 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-58fb50a7-a048-4d74-862f-6be44de2d8f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:16.496282 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-58fb50a7-a048-4d74-862f-6be44de2d8f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:16.502599 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58fb50a7-a048-4d74-862f-6be44de2d8f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:16.503384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58fb50a7-a048-4d74-862f-6be44de2d8f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:16.504129 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58fb50a7-a048-4d74-862f-6be44de2d8f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:16.505008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58fb50a7-a048-4d74-862f-6be44de2d8f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:16.505644 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58fb50a7-a048-4d74-862f-6be44de2d8f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:16.506059 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58fb50a7-a048-4d74-862f-6be44de2d8f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:16.654362 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-58fb50a7-a048-4d74-862f-6be44de2d8f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:16.668441 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-58fb50a7-a048-4d74-862f-6be44de2d8f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 0.177703 Sep 20 22:24:16.669054 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 33/59] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:16 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:16.902640 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6fa62e7b-6777-49d2-9f2a-a8c972581f3a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:16.903638 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-6fa62e7b-6777-49d2-9f2a-a8c972581f3a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:16.913634 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6fa62e7b-6777-49d2-9f2a-a8c972581f3a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:16.914672 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6fa62e7b-6777-49d2-9f2a-a8c972581f3a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:16.916292 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6fa62e7b-6777-49d2-9f2a-a8c972581f3a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:16.917486 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6fa62e7b-6777-49d2-9f2a-a8c972581f3a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:16.918590 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6fa62e7b-6777-49d2-9f2a-a8c972581f3a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:16.919641 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6fa62e7b-6777-49d2-9f2a-a8c972581f3a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:17.014938 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9eec3af2-b626-439a-8131-1fc1cd9a6de5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:17.015823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9eec3af2-b626-439a-8131-1fc1cd9a6de5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:17.027063 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9eec3af2-b626-439a-8131-1fc1cd9a6de5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:17.027960 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9eec3af2-b626-439a-8131-1fc1cd9a6de5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:17.029929 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9eec3af2-b626-439a-8131-1fc1cd9a6de5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:17.031556 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9eec3af2-b626-439a-8131-1fc1cd9a6de5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:17.032378 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9eec3af2-b626-439a-8131-1fc1cd9a6de5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:17.033765 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9eec3af2-b626-439a-8131-1fc1cd9a6de5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:17.236404 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-9eec3af2-b626-439a-8131-1fc1cd9a6de5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:17.250318 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-9eec3af2-b626-439a-8131-1fc1cd9a6de5 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.238955 Sep 20 22:24:17.251655 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 34/60] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:17 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:17.258231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-32a9b0d1-e89d-4585-9a36-3e4a7e0fdec6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:17.258849 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-32a9b0d1-e89d-4585-9a36-3e4a7e0fdec6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:17.266212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-32a9b0d1-e89d-4585-9a36-3e4a7e0fdec6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:17.266694 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-32a9b0d1-e89d-4585-9a36-3e4a7e0fdec6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:17.267298 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-32a9b0d1-e89d-4585-9a36-3e4a7e0fdec6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:17.268145 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-32a9b0d1-e89d-4585-9a36-3e4a7e0fdec6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:17.268756 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-32a9b0d1-e89d-4585-9a36-3e4a7e0fdec6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:17.269208 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-32a9b0d1-e89d-4585-9a36-3e4a7e0fdec6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:17.312989 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-6fa62e7b-6777-49d2-9f2a-a8c972581f3a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:17.321327 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-6fa62e7b-6777-49d2-9f2a-a8c972581f3a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 0.424082 Sep 20 22:24:17.322268 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 27/61] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:16 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:17.349878 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-32a9b0d1-e89d-4585-9a36-3e4a7e0fdec6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:17.360231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-32a9b0d1-e89d-4585-9a36-3e4a7e0fdec6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:17.361700 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-32a9b0d1-e89d-4585-9a36-3e4a7e0fdec6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:17.362987 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-32a9b0d1-e89d-4585-9a36-3e4a7e0fdec6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1334 microversion: 2.20 time: 0.109959 Sep 20 22:24:17.363543 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 35/62] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:17 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1334 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:17.691325 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0352ac04-073c-4706-932e-3069f6ba29b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:17.691940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-0352ac04-073c-4706-932e-3069f6ba29b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:17.698407 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0352ac04-073c-4706-932e-3069f6ba29b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:17.698887 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0352ac04-073c-4706-932e-3069f6ba29b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:17.699318 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0352ac04-073c-4706-932e-3069f6ba29b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:17.700006 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0352ac04-073c-4706-932e-3069f6ba29b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:17.700453 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0352ac04-073c-4706-932e-3069f6ba29b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:17.700872 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0352ac04-073c-4706-932e-3069f6ba29b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:17.842778 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-0352ac04-073c-4706-932e-3069f6ba29b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:17.854618 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-0352ac04-073c-4706-932e-3069f6ba29b3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 0.166982 Sep 20 22:24:17.856060 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 28/63] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:17 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:18.276269 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-6513ffa2-2bf2-47fb-af3a-16deac010d8f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:18.277690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-6513ffa2-2bf2-47fb-af3a-16deac010d8f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:18.284506 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6513ffa2-2bf2-47fb-af3a-16deac010d8f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:18.285130 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6513ffa2-2bf2-47fb-af3a-16deac010d8f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:18.285656 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6513ffa2-2bf2-47fb-af3a-16deac010d8f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:18.289827 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6513ffa2-2bf2-47fb-af3a-16deac010d8f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:18.290413 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6513ffa2-2bf2-47fb-af3a-16deac010d8f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:18.291169 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6513ffa2-2bf2-47fb-af3a-16deac010d8f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:18.344489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-86359702-59c0-456f-9338-a3c15b34d3d3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:18.345145 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-86359702-59c0-456f-9338-a3c15b34d3d3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:18.351933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-86359702-59c0-456f-9338-a3c15b34d3d3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:18.352433 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-86359702-59c0-456f-9338-a3c15b34d3d3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:18.353513 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-86359702-59c0-456f-9338-a3c15b34d3d3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:18.354227 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-86359702-59c0-456f-9338-a3c15b34d3d3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:18.354727 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-86359702-59c0-456f-9338-a3c15b34d3d3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:18.355157 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-86359702-59c0-456f-9338-a3c15b34d3d3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:18.434414 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6513ffa2-2bf2-47fb-af3a-16deac010d8f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:18.443439 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-6513ffa2-2bf2-47fb-af3a-16deac010d8f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.171713 Sep 20 22:24:18.444791 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 36/64] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:18 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:18.457789 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ba9dee83-2c71-46a9-80d8-e2b901bac497 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:18.458412 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ba9dee83-2c71-46a9-80d8-e2b901bac497 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:18.467046 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ba9dee83-2c71-46a9-80d8-e2b901bac497 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:18.467710 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ba9dee83-2c71-46a9-80d8-e2b901bac497 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:18.468616 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ba9dee83-2c71-46a9-80d8-e2b901bac497 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:18.469663 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ba9dee83-2c71-46a9-80d8-e2b901bac497 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:18.470460 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ba9dee83-2c71-46a9-80d8-e2b901bac497 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:18.471038 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ba9dee83-2c71-46a9-80d8-e2b901bac497 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:18.512516 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-86359702-59c0-456f-9338-a3c15b34d3d3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:18.533777 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-86359702-59c0-456f-9338-a3c15b34d3d3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 0.193151 Sep 20 22:24:18.534471 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 29/65] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:18 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:18.549274 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ba9dee83-2c71-46a9-80d8-e2b901bac497 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:18.558948 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ba9dee83-2c71-46a9-80d8-e2b901bac497 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:18.561084 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ba9dee83-2c71-46a9-80d8-e2b901bac497 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:18.562360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ba9dee83-2c71-46a9-80d8-e2b901bac497 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1334 microversion: 2.20 time: 0.111771 Sep 20 22:24:18.563059 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 37/66] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:18 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1334 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:18.880000 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-fcc7d5d9-56a4-43d2-b75a-675e0f198fe9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:18.881012 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-fcc7d5d9-56a4-43d2-b75a-675e0f198fe9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:18.901904 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fcc7d5d9-56a4-43d2-b75a-675e0f198fe9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:18.902408 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fcc7d5d9-56a4-43d2-b75a-675e0f198fe9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:18.902850 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fcc7d5d9-56a4-43d2-b75a-675e0f198fe9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:18.903683 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fcc7d5d9-56a4-43d2-b75a-675e0f198fe9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:18.905366 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fcc7d5d9-56a4-43d2-b75a-675e0f198fe9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:18.905366 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fcc7d5d9-56a4-43d2-b75a-675e0f198fe9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:19.163283 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-fcc7d5d9-56a4-43d2-b75a-675e0f198fe9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:19.173503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-fcc7d5d9-56a4-43d2-b75a-675e0f198fe9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 0.298012 Sep 20 22:24:19.174095 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 30/67] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:18 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:19.467618 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-31390eec-dcd9-4014-ae9e-20f7ddc00102 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:19.468230 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-31390eec-dcd9-4014-ae9e-20f7ddc00102 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:19.478712 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-31390eec-dcd9-4014-ae9e-20f7ddc00102 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:19.479516 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-31390eec-dcd9-4014-ae9e-20f7ddc00102 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:19.482410 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-31390eec-dcd9-4014-ae9e-20f7ddc00102 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:19.483330 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-31390eec-dcd9-4014-ae9e-20f7ddc00102 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:19.484870 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-31390eec-dcd9-4014-ae9e-20f7ddc00102 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:19.498182 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-31390eec-dcd9-4014-ae9e-20f7ddc00102 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:19.560375 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-fd6009be-40fa-4f2d-8636-df73616e67b3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:19.561638 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-fd6009be-40fa-4f2d-8636-df73616e67b3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:19.571040 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fd6009be-40fa-4f2d-8636-df73616e67b3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:19.571540 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fd6009be-40fa-4f2d-8636-df73616e67b3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:19.571983 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fd6009be-40fa-4f2d-8636-df73616e67b3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:19.572684 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fd6009be-40fa-4f2d-8636-df73616e67b3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:19.573718 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fd6009be-40fa-4f2d-8636-df73616e67b3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:19.574132 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fd6009be-40fa-4f2d-8636-df73616e67b3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:19.840656 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-31390eec-dcd9-4014-ae9e-20f7ddc00102 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:19.849573 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-31390eec-dcd9-4014-ae9e-20f7ddc00102 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.386402 Sep 20 22:24:19.850567 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 38/68] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:19 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:19.855898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3905d2a2-16ce-494b-9c71-a81aa3bbaf5d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:19.857041 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-3905d2a2-16ce-494b-9c71-a81aa3bbaf5d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:19.877857 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3905d2a2-16ce-494b-9c71-a81aa3bbaf5d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:19.878433 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3905d2a2-16ce-494b-9c71-a81aa3bbaf5d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:19.878935 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3905d2a2-16ce-494b-9c71-a81aa3bbaf5d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:19.881400 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3905d2a2-16ce-494b-9c71-a81aa3bbaf5d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:19.882321 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3905d2a2-16ce-494b-9c71-a81aa3bbaf5d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:19.883381 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3905d2a2-16ce-494b-9c71-a81aa3bbaf5d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:19.919278 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-fd6009be-40fa-4f2d-8636-df73616e67b3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:19.932216 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-fd6009be-40fa-4f2d-8636-df73616e67b3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 0.376117 Sep 20 22:24:19.937908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 31/69] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:19 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:20.005029 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3905d2a2-16ce-494b-9c71-a81aa3bbaf5d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:20.023612 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3905d2a2-16ce-494b-9c71-a81aa3bbaf5d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:20.025356 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3905d2a2-16ce-494b-9c71-a81aa3bbaf5d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:20.027077 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-3905d2a2-16ce-494b-9c71-a81aa3bbaf5d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1340 microversion: 2.20 time: 0.174857 Sep 20 22:24:20.027662 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 39/70] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:19 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1340 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:20.199078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-be5780cb-03fd-419b-811c-1ab9c5d80f13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:20.200071 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-be5780cb-03fd-419b-811c-1ab9c5d80f13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:20.206830 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-be5780cb-03fd-419b-811c-1ab9c5d80f13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:20.207427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-be5780cb-03fd-419b-811c-1ab9c5d80f13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:20.208221 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-be5780cb-03fd-419b-811c-1ab9c5d80f13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:20.209435 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-be5780cb-03fd-419b-811c-1ab9c5d80f13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:20.210251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-be5780cb-03fd-419b-811c-1ab9c5d80f13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:20.211043 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-be5780cb-03fd-419b-811c-1ab9c5d80f13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:20.409298 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-be5780cb-03fd-419b-811c-1ab9c5d80f13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:20.424322 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-be5780cb-03fd-419b-811c-1ab9c5d80f13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 0.229590 Sep 20 22:24:20.425692 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 32/71] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:20 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:20.881595 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-17082a99-e625-4625-b12b-1207f516dfa2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:20.882209 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-17082a99-e625-4625-b12b-1207f516dfa2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:20.888362 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-17082a99-e625-4625-b12b-1207f516dfa2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:20.888850 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-17082a99-e625-4625-b12b-1207f516dfa2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:20.889312 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-17082a99-e625-4625-b12b-1207f516dfa2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:20.890158 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-17082a99-e625-4625-b12b-1207f516dfa2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:20.890786 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-17082a99-e625-4625-b12b-1207f516dfa2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:20.891258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-17082a99-e625-4625-b12b-1207f516dfa2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:20.967051 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-baec9b93-fedd-4b4d-a29e-7cee37ef6e9d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:20.967815 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-baec9b93-fedd-4b4d-a29e-7cee37ef6e9d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:20.973807 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-baec9b93-fedd-4b4d-a29e-7cee37ef6e9d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:20.974422 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-baec9b93-fedd-4b4d-a29e-7cee37ef6e9d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:20.974860 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-baec9b93-fedd-4b4d-a29e-7cee37ef6e9d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:20.975638 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-baec9b93-fedd-4b4d-a29e-7cee37ef6e9d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:20.976439 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-baec9b93-fedd-4b4d-a29e-7cee37ef6e9d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:20.977096 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-baec9b93-fedd-4b4d-a29e-7cee37ef6e9d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:21.040496 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-17082a99-e625-4625-b12b-1207f516dfa2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:21.051574 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-17082a99-e625-4625-b12b-1207f516dfa2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.173775 Sep 20 22:24:21.052156 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 40/72] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:20 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:21.067622 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-6b5d4f03-b63d-4945-a20f-e309631e6711 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:21.069664 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-6b5d4f03-b63d-4945-a20f-e309631e6711 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:21.076531 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6b5d4f03-b63d-4945-a20f-e309631e6711 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:21.077113 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6b5d4f03-b63d-4945-a20f-e309631e6711 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:21.077602 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6b5d4f03-b63d-4945-a20f-e309631e6711 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:21.078578 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6b5d4f03-b63d-4945-a20f-e309631e6711 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:21.079330 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6b5d4f03-b63d-4945-a20f-e309631e6711 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:21.079927 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6b5d4f03-b63d-4945-a20f-e309631e6711 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:21.138375 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-baec9b93-fedd-4b4d-a29e-7cee37ef6e9d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:21.146615 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-baec9b93-fedd-4b4d-a29e-7cee37ef6e9d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 0.184170 Sep 20 22:24:21.147529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 33/73] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:20 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:21.159778 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6b5d4f03-b63d-4945-a20f-e309631e6711 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:21.168631 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6b5d4f03-b63d-4945-a20f-e309631e6711 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:21.170149 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6b5d4f03-b63d-4945-a20f-e309631e6711 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:21.171281 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-6b5d4f03-b63d-4945-a20f-e309631e6711 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1340 microversion: 2.20 time: 0.107838 Sep 20 22:24:21.171828 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 41/74] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:21 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1340 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:21.458067 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a9cdc549-00c8-4b7c-bfb4-861d790a2888 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:21.459100 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a9cdc549-00c8-4b7c-bfb4-861d790a2888 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:21.472076 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a9cdc549-00c8-4b7c-bfb4-861d790a2888 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:21.475426 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a9cdc549-00c8-4b7c-bfb4-861d790a2888 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:21.476126 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a9cdc549-00c8-4b7c-bfb4-861d790a2888 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:21.477195 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a9cdc549-00c8-4b7c-bfb4-861d790a2888 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:21.477837 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a9cdc549-00c8-4b7c-bfb4-861d790a2888 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:21.478419 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a9cdc549-00c8-4b7c-bfb4-861d790a2888 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:21.647410 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a9cdc549-00c8-4b7c-bfb4-861d790a2888 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:21.658366 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a9cdc549-00c8-4b7c-bfb4-861d790a2888 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 0.203517 Sep 20 22:24:21.658366 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 34/75] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:21 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:22.075693 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-1b5f6e3f-39ec-45fe-81b1-17544c540614 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:22.076313 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-1b5f6e3f-39ec-45fe-81b1-17544c540614 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:22.079241 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=2 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:22.083417 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1b5f6e3f-39ec-45fe-81b1-17544c540614 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:22.083919 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1b5f6e3f-39ec-45fe-81b1-17544c540614 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:22.084367 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1b5f6e3f-39ec-45fe-81b1-17544c540614 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:22.085106 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1b5f6e3f-39ec-45fe-81b1-17544c540614 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:22.085728 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1b5f6e3f-39ec-45fe-81b1-17544c540614 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:22.086319 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1b5f6e3f-39ec-45fe-81b1-17544c540614 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:22.174722 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-2f5e02fd-aaf9-4992-a8a2-ab779da9bb30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:22.176113 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-2f5e02fd-aaf9-4992-a8a2-ab779da9bb30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:22.186838 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2f5e02fd-aaf9-4992-a8a2-ab779da9bb30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:22.187555 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2f5e02fd-aaf9-4992-a8a2-ab779da9bb30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:22.189958 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2f5e02fd-aaf9-4992-a8a2-ab779da9bb30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:22.191285 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2f5e02fd-aaf9-4992-a8a2-ab779da9bb30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:22.192235 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2f5e02fd-aaf9-4992-a8a2-ab779da9bb30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:22.193457 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2f5e02fd-aaf9-4992-a8a2-ab779da9bb30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:22.259536 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-1b5f6e3f-39ec-45fe-81b1-17544c540614 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:22.267156 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-1b5f6e3f-39ec-45fe-81b1-17544c540614 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.195324 Sep 20 22:24:22.267728 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 42/76] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:22 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:22.273012 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-6f28f097-d04c-4976-93f6-697a32dbc647 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:22.273621 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-6f28f097-d04c-4976-93f6-697a32dbc647 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:22.281131 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6f28f097-d04c-4976-93f6-697a32dbc647 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:22.281853 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6f28f097-d04c-4976-93f6-697a32dbc647 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:22.282393 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6f28f097-d04c-4976-93f6-697a32dbc647 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:22.283160 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6f28f097-d04c-4976-93f6-697a32dbc647 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:22.283684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6f28f097-d04c-4976-93f6-697a32dbc647 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:22.284181 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6f28f097-d04c-4976-93f6-697a32dbc647 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:22.345953 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6f28f097-d04c-4976-93f6-697a32dbc647 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:22.354239 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6f28f097-d04c-4976-93f6-697a32dbc647 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:22.355824 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6f28f097-d04c-4976-93f6-697a32dbc647 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:22.356936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-6f28f097-d04c-4976-93f6-697a32dbc647 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1340 microversion: 2.20 time: 0.087431 Sep 20 22:24:22.357566 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 43/77] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:22 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1340 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:22.431994 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-2f5e02fd-aaf9-4992-a8a2-ab779da9bb30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:22.442903 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-2f5e02fd-aaf9-4992-a8a2-ab779da9bb30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 0.274504 Sep 20 22:24:22.447661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 35/78] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:22 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:22.681049 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-51724780-6b3c-4b20-a888-703b61b2c05c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:22.682287 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-51724780-6b3c-4b20-a888-703b61b2c05c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:22.690628 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-51724780-6b3c-4b20-a888-703b61b2c05c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:22.691468 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-51724780-6b3c-4b20-a888-703b61b2c05c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:22.692085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-51724780-6b3c-4b20-a888-703b61b2c05c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:22.693250 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-51724780-6b3c-4b20-a888-703b61b2c05c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:22.694296 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-51724780-6b3c-4b20-a888-703b61b2c05c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:22.695130 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-51724780-6b3c-4b20-a888-703b61b2c05c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:23.006798 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-51724780-6b3c-4b20-a888-703b61b2c05c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:23.017456 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-51724780-6b3c-4b20-a888-703b61b2c05c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 0.342565 Sep 20 22:24:23.018203 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 44/79] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:22 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:23.290798 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-5e827e7e-8ec7-4b66-89fd-cf4d96bd4953 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:23.293011 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-5e827e7e-8ec7-4b66-89fd-cf4d96bd4953 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:23.299648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5e827e7e-8ec7-4b66-89fd-cf4d96bd4953 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:23.300477 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5e827e7e-8ec7-4b66-89fd-cf4d96bd4953 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:23.301230 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5e827e7e-8ec7-4b66-89fd-cf4d96bd4953 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:23.302353 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5e827e7e-8ec7-4b66-89fd-cf4d96bd4953 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:23.303020 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5e827e7e-8ec7-4b66-89fd-cf4d96bd4953 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:23.305307 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5e827e7e-8ec7-4b66-89fd-cf4d96bd4953 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:23.385881 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-652449fc-d936-400b-93f1-9de6868e7bbd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:23.387096 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-652449fc-d936-400b-93f1-9de6868e7bbd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:23.395675 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-652449fc-d936-400b-93f1-9de6868e7bbd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:23.396247 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-652449fc-d936-400b-93f1-9de6868e7bbd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:23.396770 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-652449fc-d936-400b-93f1-9de6868e7bbd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:23.398043 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-652449fc-d936-400b-93f1-9de6868e7bbd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:23.398650 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-652449fc-d936-400b-93f1-9de6868e7bbd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:23.399221 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-652449fc-d936-400b-93f1-9de6868e7bbd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:23.545880 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-652449fc-d936-400b-93f1-9de6868e7bbd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:23.561075 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-652449fc-d936-400b-93f1-9de6868e7bbd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:23.563533 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-652449fc-d936-400b-93f1-9de6868e7bbd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:23.568748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-652449fc-d936-400b-93f1-9de6868e7bbd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1340 microversion: 2.20 time: 0.186038 Sep 20 22:24:23.570582 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 45/80] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:23 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1340 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:24:23.589753 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-5e827e7e-8ec7-4b66-89fd-cf4d96bd4953 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:23.595391 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-63b1e78a-bb2a-4724-82af-4b6d88df3756 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:23.596368 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-63b1e78a-bb2a-4724-82af-4b6d88df3756 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:23.603960 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-63b1e78a-bb2a-4724-82af-4b6d88df3756 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:23.605342 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-5e827e7e-8ec7-4b66-89fd-cf4d96bd4953 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.318437 Sep 20 22:24:23.605693 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-63b1e78a-bb2a-4724-82af-4b6d88df3756 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:23.605932 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 36/81] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:23 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:23.606504 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-63b1e78a-bb2a-4724-82af-4b6d88df3756 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:23.607360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-63b1e78a-bb2a-4724-82af-4b6d88df3756 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:23.607959 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-63b1e78a-bb2a-4724-82af-4b6d88df3756 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:23.608675 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-63b1e78a-bb2a-4724-82af-4b6d88df3756 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:23.926953 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-63b1e78a-bb2a-4724-82af-4b6d88df3756 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:23.935964 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-63b1e78a-bb2a-4724-82af-4b6d88df3756 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 0.352983 Sep 20 22:24:23.941755 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 46/82] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:23 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:24.050417 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6edf74c6-64af-4b0d-9ff2-61c65231b47c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:24.051383 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-6edf74c6-64af-4b0d-9ff2-61c65231b47c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:24.072578 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6edf74c6-64af-4b0d-9ff2-61c65231b47c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:24.073447 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6edf74c6-64af-4b0d-9ff2-61c65231b47c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:24.074097 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6edf74c6-64af-4b0d-9ff2-61c65231b47c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:24.075726 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6edf74c6-64af-4b0d-9ff2-61c65231b47c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:24.082195 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6edf74c6-64af-4b0d-9ff2-61c65231b47c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:24.083905 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6edf74c6-64af-4b0d-9ff2-61c65231b47c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:24.415779 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-6edf74c6-64af-4b0d-9ff2-61c65231b47c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:24.428216 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-6edf74c6-64af-4b0d-9ff2-61c65231b47c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 0.390377 Sep 20 22:24:24.429653 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 37/83] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:24 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:24.606972 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-09275396-a3f4-450d-a94a-557b6a6ef955 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:24.608411 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-09275396-a3f4-450d-a94a-557b6a6ef955 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:24.617194 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-09275396-a3f4-450d-a94a-557b6a6ef955 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:24.618341 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-09275396-a3f4-450d-a94a-557b6a6ef955 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:24.621118 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-09275396-a3f4-450d-a94a-557b6a6ef955 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:24.621939 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-09275396-a3f4-450d-a94a-557b6a6ef955 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:24.623727 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-09275396-a3f4-450d-a94a-557b6a6ef955 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:24.623727 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-09275396-a3f4-450d-a94a-557b6a6ef955 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:24.629135 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-50cead22-76b0-4ef5-acaf-2d08271dc550 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:24.629876 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-50cead22-76b0-4ef5-acaf-2d08271dc550 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:24.632052 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=4 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:24.643055 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-50cead22-76b0-4ef5-acaf-2d08271dc550 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:24.643548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-50cead22-76b0-4ef5-acaf-2d08271dc550 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:24.643986 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-50cead22-76b0-4ef5-acaf-2d08271dc550 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:24.644873 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-50cead22-76b0-4ef5-acaf-2d08271dc550 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:24.645153 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-50cead22-76b0-4ef5-acaf-2d08271dc550 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:24.645574 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-50cead22-76b0-4ef5-acaf-2d08271dc550 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:24.771814 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-09275396-a3f4-450d-a94a-557b6a6ef955 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:24.782982 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-09275396-a3f4-450d-a94a-557b6a6ef955 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:24.784676 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-09275396-a3f4-450d-a94a-557b6a6ef955 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:24.785824 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-09275396-a3f4-450d-a94a-557b6a6ef955 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1340 microversion: 2.20 time: 0.189631 Sep 20 22:24:24.787562 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 47/84] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:24 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1340 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:24.901746 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=8 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:24.966764 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c44941e3-d4e4-4dda-93fd-a0314df606cd tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:24.967606 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-c44941e3-d4e4-4dda-93fd-a0314df606cd tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:24.983060 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c44941e3-d4e4-4dda-93fd-a0314df606cd tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:24.984310 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c44941e3-d4e4-4dda-93fd-a0314df606cd tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:24.986593 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c44941e3-d4e4-4dda-93fd-a0314df606cd tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:24.991403 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c44941e3-d4e4-4dda-93fd-a0314df606cd tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:24.992167 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c44941e3-d4e4-4dda-93fd-a0314df606cd tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:24.994508 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c44941e3-d4e4-4dda-93fd-a0314df606cd tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:25.111206 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-50cead22-76b0-4ef5-acaf-2d08271dc550 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:25.124953 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-50cead22-76b0-4ef5-acaf-2d08271dc550 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.499045 Sep 20 22:24:25.128386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 38/85] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:24 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:25.563085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-c44941e3-d4e4-4dda-93fd-a0314df606cd tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:25.574515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=100 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:25.587565 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c44941e3-d4e4-4dda-93fd-a0314df606cd tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 0.625795 Sep 20 22:24:25.591025 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 48/86] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:24 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:25.610669 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-27568187-0df6-4e0e-a2d2-dec636d4b27b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:25.611708 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-27568187-0df6-4e0e-a2d2-dec636d4b27b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:25.637770 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-27568187-0df6-4e0e-a2d2-dec636d4b27b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:25.637770 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-27568187-0df6-4e0e-a2d2-dec636d4b27b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:25.637770 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-27568187-0df6-4e0e-a2d2-dec636d4b27b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:25.638486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-27568187-0df6-4e0e-a2d2-dec636d4b27b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:25.638938 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-27568187-0df6-4e0e-a2d2-dec636d4b27b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:25.639362 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-27568187-0df6-4e0e-a2d2-dec636d4b27b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:25.662118 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-97d293ae-063b-48a6-a348-db9dfbcec0e2 req-f5b607ac-e180-44a8-9e63-8dcf83e67531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b72562d-a97c-4822-bb23-f96a857ce91e", "name": "network-vif-plugged", "status": "completed", "tag": "2935ce4a-cc6e-475c-a649-2b15aa333949"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:24:25.730174 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-97d293ae-063b-48a6-a348-db9dfbcec0e2 req-f5b607ac-e180-44a8-9e63-8dcf83e67531 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:25.730669 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-97d293ae-063b-48a6-a348-db9dfbcec0e2 req-f5b607ac-e180-44a8-9e63-8dcf83e67531 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:25.731101 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-97d293ae-063b-48a6-a348-db9dfbcec0e2 req-f5b607ac-e180-44a8-9e63-8dcf83e67531 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:25.758157 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-97d293ae-063b-48a6-a348-db9dfbcec0e2 req-f5b607ac-e180-44a8-9e63-8dcf83e67531 service nova] Creating event network-vif-plugged:2935ce4a-cc6e-475c-a649-2b15aa333949 for instance 7b72562d-a97c-4822-bb23-f96a857ce91e on hv-cinder-85827 Sep 20 22:24:25.784057 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-97d293ae-063b-48a6-a348-db9dfbcec0e2 req-f5b607ac-e180-44a8-9e63-8dcf83e67531 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.459404 Sep 20 22:24:25.784738 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 39/87] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:24:25.814440 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-f1ed2c4a-9023-43e6-8cef-d022a0620958 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:25.815156 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-f1ed2c4a-9023-43e6-8cef-d022a0620958 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:25.829830 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f1ed2c4a-9023-43e6-8cef-d022a0620958 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:25.830614 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f1ed2c4a-9023-43e6-8cef-d022a0620958 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:25.831066 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f1ed2c4a-9023-43e6-8cef-d022a0620958 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:25.831989 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f1ed2c4a-9023-43e6-8cef-d022a0620958 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:25.832779 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f1ed2c4a-9023-43e6-8cef-d022a0620958 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:25.833217 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f1ed2c4a-9023-43e6-8cef-d022a0620958 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:25.861726 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=100 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:25.967473 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-27568187-0df6-4e0e-a2d2-dec636d4b27b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:25.977927 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-27568187-0df6-4e0e-a2d2-dec636d4b27b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 0.385424 Sep 20 22:24:25.995826 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 49/88] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:25 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:26.147145 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f1ed2c4a-9023-43e6-8cef-d022a0620958 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:26.159095 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f1ed2c4a-9023-43e6-8cef-d022a0620958 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:26.161016 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f1ed2c4a-9023-43e6-8cef-d022a0620958 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:26.162417 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-f1ed2c4a-9023-43e6-8cef-d022a0620958 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1407 microversion: 2.20 time: 0.354607 Sep 20 22:24:26.163557 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 40/89] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:25 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1407 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:24:26.179193 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-47767c83-b4d8-45ff-b710-d5c794cccbc0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:26.179824 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-47767c83-b4d8-45ff-b710-d5c794cccbc0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:26.191176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-47767c83-b4d8-45ff-b710-d5c794cccbc0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:26.191958 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-47767c83-b4d8-45ff-b710-d5c794cccbc0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:26.192613 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-47767c83-b4d8-45ff-b710-d5c794cccbc0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:26.193587 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-47767c83-b4d8-45ff-b710-d5c794cccbc0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:26.194227 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-47767c83-b4d8-45ff-b710-d5c794cccbc0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:26.194836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-47767c83-b4d8-45ff-b710-d5c794cccbc0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:26.396583 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-47767c83-b4d8-45ff-b710-d5c794cccbc0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:26.407686 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-47767c83-b4d8-45ff-b710-d5c794cccbc0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.247894 Sep 20 22:24:26.409067 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 50/90] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:26 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:26.617336 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0f3c4b0a-33a9-41bd-accc-1152a789a598 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:26.618007 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-0f3c4b0a-33a9-41bd-accc-1152a789a598 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:26.629792 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0f3c4b0a-33a9-41bd-accc-1152a789a598 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:26.630514 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0f3c4b0a-33a9-41bd-accc-1152a789a598 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:26.631347 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0f3c4b0a-33a9-41bd-accc-1152a789a598 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:26.632398 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0f3c4b0a-33a9-41bd-accc-1152a789a598 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:26.633013 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0f3c4b0a-33a9-41bd-accc-1152a789a598 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:26.633509 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0f3c4b0a-33a9-41bd-accc-1152a789a598 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:26.911107 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-0f3c4b0a-33a9-41bd-accc-1152a789a598 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:26.920389 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-0f3c4b0a-33a9-41bd-accc-1152a789a598 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 0.307066 Sep 20 22:24:26.921557 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 41/91] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:26 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:26.953156 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-98029986-4f72-40fe-a595-f981d37041d2 req-d21359ad-b167-40e0-b290-40e16df516a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d58779-65b7-4b97-8536-eef4357a475d", "tag": "d965769d-834a-4b9f-817a-24e086032c2d"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:24:26.970497 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-98029986-4f72-40fe-a595-f981d37041d2 req-d21359ad-b167-40e0-b290-40e16df516a1 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:26.971393 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-98029986-4f72-40fe-a595-f981d37041d2 req-d21359ad-b167-40e0-b290-40e16df516a1 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:26.972058 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-98029986-4f72-40fe-a595-f981d37041d2 req-d21359ad-b167-40e0-b290-40e16df516a1 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:26.995860 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-98029986-4f72-40fe-a595-f981d37041d2 req-d21359ad-b167-40e0-b290-40e16df516a1 service nova] Creating event network-changed:d965769d-834a-4b9f-817a-24e086032c2d for instance 48d58779-65b7-4b97-8536-eef4357a475d on hv-cinder-85827 Sep 20 22:24:27.003020 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-e7ab15da-e350-4fba-abf9-d943762c3a1b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:27.003793 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-e7ab15da-e350-4fba-abf9-d943762c3a1b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:27.007299 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-98029986-4f72-40fe-a595-f981d37041d2 req-d21359ad-b167-40e0-b290-40e16df516a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059182 Sep 20 22:24:27.008816 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 51/92] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:24:27.016188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e7ab15da-e350-4fba-abf9-d943762c3a1b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:27.016895 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e7ab15da-e350-4fba-abf9-d943762c3a1b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:27.017528 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e7ab15da-e350-4fba-abf9-d943762c3a1b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:27.019335 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e7ab15da-e350-4fba-abf9-d943762c3a1b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:27.022497 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e7ab15da-e350-4fba-abf9-d943762c3a1b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:27.023307 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e7ab15da-e350-4fba-abf9-d943762c3a1b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:27.195338 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-8226fb96-f8ea-46e4-9c07-cbcc398247b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:27.196045 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-8226fb96-f8ea-46e4-9c07-cbcc398247b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:27.207161 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8226fb96-f8ea-46e4-9c07-cbcc398247b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:27.207658 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8226fb96-f8ea-46e4-9c07-cbcc398247b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:27.208610 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8226fb96-f8ea-46e4-9c07-cbcc398247b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:27.210925 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8226fb96-f8ea-46e4-9c07-cbcc398247b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:27.211537 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8226fb96-f8ea-46e4-9c07-cbcc398247b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:27.216079 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8226fb96-f8ea-46e4-9c07-cbcc398247b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:27.269024 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-e7ab15da-e350-4fba-abf9-d943762c3a1b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:27.277789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-e7ab15da-e350-4fba-abf9-d943762c3a1b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 0.279101 Sep 20 22:24:27.278371 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 42/93] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:26 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:27.419555 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-8226fb96-f8ea-46e4-9c07-cbcc398247b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:27.435342 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-19393614-58ef-48d0-ac75-02a14d7ae277 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:27.435958 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-19393614-58ef-48d0-ac75-02a14d7ae277 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:27.442009 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-8226fb96-f8ea-46e4-9c07-cbcc398247b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:27.443776 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-8226fb96-f8ea-46e4-9c07-cbcc398247b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:27.445009 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-8226fb96-f8ea-46e4-9c07-cbcc398247b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1407 microversion: 2.20 time: 0.254040 Sep 20 22:24:27.450476 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-19393614-58ef-48d0-ac75-02a14d7ae277 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:27.451173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-19393614-58ef-48d0-ac75-02a14d7ae277 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:27.451778 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-19393614-58ef-48d0-ac75-02a14d7ae277 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:27.452644 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-19393614-58ef-48d0-ac75-02a14d7ae277 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:27.453287 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-19393614-58ef-48d0-ac75-02a14d7ae277 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:27.453720 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-19393614-58ef-48d0-ac75-02a14d7ae277 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:27.461254 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 52/94] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:27 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:27.622958 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-19393614-58ef-48d0-ac75-02a14d7ae277 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:27.633094 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-19393614-58ef-48d0-ac75-02a14d7ae277 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.201526 Sep 20 22:24:27.633689 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 43/95] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:27 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:27.809963 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-58512659-c4d7-4d54-aeb3-d1fac6a03d81 req-bd5e8135-c55e-467c-bcdf-539cf65a7fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89747cc8-0eba-4b3b-8fec-ec0663bc51d0", "name": "network-vif-plugged", "status": "completed", "tag": "beceeb78-fe70-47d6-98db-538612768bf8"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:24:27.820624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-58512659-c4d7-4d54-aeb3-d1fac6a03d81 req-bd5e8135-c55e-467c-bcdf-539cf65a7fd0 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:27.821338 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-58512659-c4d7-4d54-aeb3-d1fac6a03d81 req-bd5e8135-c55e-467c-bcdf-539cf65a7fd0 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:27.822010 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-58512659-c4d7-4d54-aeb3-d1fac6a03d81 req-bd5e8135-c55e-467c-bcdf-539cf65a7fd0 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:27.835044 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-58512659-c4d7-4d54-aeb3-d1fac6a03d81 req-bd5e8135-c55e-467c-bcdf-539cf65a7fd0 service nova] Creating event network-vif-plugged:beceeb78-fe70-47d6-98db-538612768bf8 for instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 on hv-cinder-85827 Sep 20 22:24:27.841210 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-58512659-c4d7-4d54-aeb3-d1fac6a03d81 req-bd5e8135-c55e-467c-bcdf-539cf65a7fd0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034974 Sep 20 22:24:27.842334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 53/96] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:24:27.944477 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-bdafb607-35c5-4dcb-be99-ad00a9541142 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:27.945880 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-bdafb607-35c5-4dcb-be99-ad00a9541142 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:27.953788 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bdafb607-35c5-4dcb-be99-ad00a9541142 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:27.954707 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bdafb607-35c5-4dcb-be99-ad00a9541142 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:27.955294 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bdafb607-35c5-4dcb-be99-ad00a9541142 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:27.956179 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bdafb607-35c5-4dcb-be99-ad00a9541142 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:27.956795 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bdafb607-35c5-4dcb-be99-ad00a9541142 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:27.957413 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bdafb607-35c5-4dcb-be99-ad00a9541142 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:28.132936 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-bdafb607-35c5-4dcb-be99-ad00a9541142 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:28.147809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-bdafb607-35c5-4dcb-be99-ad00a9541142 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 0.206535 Sep 20 22:24:28.158332 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 44/97] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:27 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:28.309605 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-55b112ad-0d72-42d1-8c40-fc971db4add6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:28.310365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-55b112ad-0d72-42d1-8c40-fc971db4add6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:28.317759 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-55b112ad-0d72-42d1-8c40-fc971db4add6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:28.318658 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-55b112ad-0d72-42d1-8c40-fc971db4add6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:28.319154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-55b112ad-0d72-42d1-8c40-fc971db4add6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:28.320024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-55b112ad-0d72-42d1-8c40-fc971db4add6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:28.320669 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-55b112ad-0d72-42d1-8c40-fc971db4add6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:28.321291 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-55b112ad-0d72-42d1-8c40-fc971db4add6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:28.486512 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-55b112ad-0d72-42d1-8c40-fc971db4add6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:28.488706 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-63a3f35e-c4f8-4b16-997f-5dccfd23e70c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:28.489555 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-63a3f35e-c4f8-4b16-997f-5dccfd23e70c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:28.497134 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-55b112ad-0d72-42d1-8c40-fc971db4add6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 0.192983 Sep 20 22:24:28.498951 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 54/98] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:28 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:28.499588 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-63a3f35e-c4f8-4b16-997f-5dccfd23e70c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:28.500105 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-63a3f35e-c4f8-4b16-997f-5dccfd23e70c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:28.500555 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-63a3f35e-c4f8-4b16-997f-5dccfd23e70c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:28.506805 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-63a3f35e-c4f8-4b16-997f-5dccfd23e70c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:28.507328 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-63a3f35e-c4f8-4b16-997f-5dccfd23e70c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:28.507778 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-63a3f35e-c4f8-4b16-997f-5dccfd23e70c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:28.658070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-831f96b0-cc9f-40ee-98f0-817b7be2b3f0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:28.658691 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-831f96b0-cc9f-40ee-98f0-817b7be2b3f0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:28.676790 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-831f96b0-cc9f-40ee-98f0-817b7be2b3f0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:28.677780 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-831f96b0-cc9f-40ee-98f0-817b7be2b3f0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:28.678393 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-831f96b0-cc9f-40ee-98f0-817b7be2b3f0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:28.681477 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-831f96b0-cc9f-40ee-98f0-817b7be2b3f0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:28.685204 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-831f96b0-cc9f-40ee-98f0-817b7be2b3f0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:28.686220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-831f96b0-cc9f-40ee-98f0-817b7be2b3f0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:29.118616 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-63a3f35e-c4f8-4b16-997f-5dccfd23e70c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:29.127733 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-63a3f35e-c4f8-4b16-997f-5dccfd23e70c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:29.135274 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-63a3f35e-c4f8-4b16-997f-5dccfd23e70c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:29.136780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-63a3f35e-c4f8-4b16-997f-5dccfd23e70c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1407 microversion: 2.20 time: 0.652181 Sep 20 22:24:29.141814 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 45/99] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:28 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1407 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:29.172944 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d930bf30-d3dd-4ab2-ae03-e046deff48bc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:29.174259 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d930bf30-d3dd-4ab2-ae03-e046deff48bc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:29.185540 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d930bf30-d3dd-4ab2-ae03-e046deff48bc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:29.186854 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d930bf30-d3dd-4ab2-ae03-e046deff48bc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:29.188165 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d930bf30-d3dd-4ab2-ae03-e046deff48bc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:29.189077 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d930bf30-d3dd-4ab2-ae03-e046deff48bc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:29.191027 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d930bf30-d3dd-4ab2-ae03-e046deff48bc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:29.193401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d930bf30-d3dd-4ab2-ae03-e046deff48bc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:29.384548 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-831f96b0-cc9f-40ee-98f0-817b7be2b3f0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:29.400267 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-831f96b0-cc9f-40ee-98f0-817b7be2b3f0 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.747779 Sep 20 22:24:29.419615 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 55/100] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:28 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:29.425777 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-d930bf30-d3dd-4ab2-ae03-e046deff48bc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:29.433799 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-d930bf30-d3dd-4ab2-ae03-e046deff48bc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 0.266499 Sep 20 22:24:29.436965 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 46/101] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:29 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:29.522387 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-e959268f-cc02-43ed-aefb-d19876f0cd39 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:29.523022 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-e959268f-cc02-43ed-aefb-d19876f0cd39 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:29.530111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e959268f-cc02-43ed-aefb-d19876f0cd39 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:29.530604 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e959268f-cc02-43ed-aefb-d19876f0cd39 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:29.531044 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e959268f-cc02-43ed-aefb-d19876f0cd39 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:29.531745 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e959268f-cc02-43ed-aefb-d19876f0cd39 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:29.532202 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e959268f-cc02-43ed-aefb-d19876f0cd39 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:29.532634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e959268f-cc02-43ed-aefb-d19876f0cd39 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:29.666108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-e959268f-cc02-43ed-aefb-d19876f0cd39 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:29.674474 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-e959268f-cc02-43ed-aefb-d19876f0cd39 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 0.156162 Sep 20 22:24:29.674894 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 56/102] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:29 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:30.169194 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-233abd30-337c-4050-84c5-e14b8b95dbcf tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:30.169907 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-233abd30-337c-4050-84c5-e14b8b95dbcf tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:30.176227 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-233abd30-337c-4050-84c5-e14b8b95dbcf tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:30.176805 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-233abd30-337c-4050-84c5-e14b8b95dbcf tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:30.177279 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-233abd30-337c-4050-84c5-e14b8b95dbcf tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:30.178377 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-233abd30-337c-4050-84c5-e14b8b95dbcf tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:30.179334 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-233abd30-337c-4050-84c5-e14b8b95dbcf tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:30.179971 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-233abd30-337c-4050-84c5-e14b8b95dbcf tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:30.400131 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-233abd30-337c-4050-84c5-e14b8b95dbcf tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:30.410533 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-233abd30-337c-4050-84c5-e14b8b95dbcf tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:30.412129 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-233abd30-337c-4050-84c5-e14b8b95dbcf tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:30.413360 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-233abd30-337c-4050-84c5-e14b8b95dbcf tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1407 microversion: 2.20 time: 0.249157 Sep 20 22:24:30.414049 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 47/103] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:30 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:30.435428 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5979479c-4099-423e-9476-d74c3ec3b8e1 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:30.436637 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5979479c-4099-423e-9476-d74c3ec3b8e1 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:30.442759 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5979479c-4099-423e-9476-d74c3ec3b8e1 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:30.443505 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5979479c-4099-423e-9476-d74c3ec3b8e1 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:30.444132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5979479c-4099-423e-9476-d74c3ec3b8e1 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:30.444843 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5979479c-4099-423e-9476-d74c3ec3b8e1 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:30.445377 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5979479c-4099-423e-9476-d74c3ec3b8e1 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:30.446021 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5979479c-4099-423e-9476-d74c3ec3b8e1 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:30.461017 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-2ae33cbe-3367-4e1a-ae46-0abfc586a0b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:30.461756 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-2ae33cbe-3367-4e1a-ae46-0abfc586a0b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:30.468691 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2ae33cbe-3367-4e1a-ae46-0abfc586a0b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:30.469494 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2ae33cbe-3367-4e1a-ae46-0abfc586a0b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:30.470511 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2ae33cbe-3367-4e1a-ae46-0abfc586a0b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:30.471500 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2ae33cbe-3367-4e1a-ae46-0abfc586a0b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:30.472404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2ae33cbe-3367-4e1a-ae46-0abfc586a0b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:30.473078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2ae33cbe-3367-4e1a-ae46-0abfc586a0b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:30.640719 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-2ae33cbe-3367-4e1a-ae46-0abfc586a0b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:30.654812 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-2ae33cbe-3367-4e1a-ae46-0abfc586a0b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 0.197640 Sep 20 22:24:30.656208 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 48/104] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:30 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:30.697613 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-7637107e-de98-4fbe-aa06-c352ba4e013f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:30.698450 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-7637107e-de98-4fbe-aa06-c352ba4e013f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:30.705038 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7637107e-de98-4fbe-aa06-c352ba4e013f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:30.705920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7637107e-de98-4fbe-aa06-c352ba4e013f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:30.706359 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7637107e-de98-4fbe-aa06-c352ba4e013f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:30.707063 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7637107e-de98-4fbe-aa06-c352ba4e013f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:30.707517 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7637107e-de98-4fbe-aa06-c352ba4e013f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:30.707940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7637107e-de98-4fbe-aa06-c352ba4e013f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:30.711802 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-5979479c-4099-423e-9476-d74c3ec3b8e1 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:30.722481 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5979479c-4099-423e-9476-d74c3ec3b8e1 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.295782 Sep 20 22:24:30.723734 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 57/105] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:30 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:30.895364 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-7637107e-de98-4fbe-aa06-c352ba4e013f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:30.904405 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-7637107e-de98-4fbe-aa06-c352ba4e013f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 0.210825 Sep 20 22:24:30.905978 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 49/106] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:30 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:30.925982 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-5dbe333d-2beb-4509-8e34-9636244e7f0a req-a191522c-e4cb-41a6-8c73-3fe219589fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc70c4c-17f0-432f-a168-0e8a0cfadf49", "name": "network-vif-plugged", "status": "completed", "tag": "a021146d-28cd-4ea4-a592-2293bed5bd15"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:24:30.936258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-5dbe333d-2beb-4509-8e34-9636244e7f0a req-a191522c-e4cb-41a6-8c73-3fe219589fc3 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:30.936743 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-5dbe333d-2beb-4509-8e34-9636244e7f0a req-a191522c-e4cb-41a6-8c73-3fe219589fc3 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:30.937236 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-5dbe333d-2beb-4509-8e34-9636244e7f0a req-a191522c-e4cb-41a6-8c73-3fe219589fc3 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:30.951652 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-5dbe333d-2beb-4509-8e34-9636244e7f0a req-a191522c-e4cb-41a6-8c73-3fe219589fc3 service nova] Creating event network-vif-plugged:a021146d-28cd-4ea4-a592-2293bed5bd15 for instance bfc70c4c-17f0-432f-a168-0e8a0cfadf49 on hv-cinder-85827 Sep 20 22:24:30.957147 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-5dbe333d-2beb-4509-8e34-9636244e7f0a req-a191522c-e4cb-41a6-8c73-3fe219589fc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036485 Sep 20 22:24:30.957970 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 58/107] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:24:31.450411 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-5838cf58-e86a-4b8b-9223-7cf48a124117 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:31.451102 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-5838cf58-e86a-4b8b-9223-7cf48a124117 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:31.459403 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5838cf58-e86a-4b8b-9223-7cf48a124117 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:31.459908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5838cf58-e86a-4b8b-9223-7cf48a124117 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:31.460344 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5838cf58-e86a-4b8b-9223-7cf48a124117 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:31.462652 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5838cf58-e86a-4b8b-9223-7cf48a124117 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:31.463135 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5838cf58-e86a-4b8b-9223-7cf48a124117 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:31.464089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5838cf58-e86a-4b8b-9223-7cf48a124117 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:31.647160 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-5838cf58-e86a-4b8b-9223-7cf48a124117 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:31.655759 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-5838cf58-e86a-4b8b-9223-7cf48a124117 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:31.657804 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-5838cf58-e86a-4b8b-9223-7cf48a124117 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:31.658924 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-5838cf58-e86a-4b8b-9223-7cf48a124117 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1407 microversion: 2.20 time: 0.212408 Sep 20 22:24:31.659480 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 50/108] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:31 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:31.683793 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-88bbed74-9d8a-448f-8c6f-3b9ce2fc34e9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:31.684694 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-88bbed74-9d8a-448f-8c6f-3b9ce2fc34e9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:31.692034 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-88bbed74-9d8a-448f-8c6f-3b9ce2fc34e9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:31.692696 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-88bbed74-9d8a-448f-8c6f-3b9ce2fc34e9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:31.693298 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-88bbed74-9d8a-448f-8c6f-3b9ce2fc34e9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:31.694331 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-88bbed74-9d8a-448f-8c6f-3b9ce2fc34e9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:31.694782 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-88bbed74-9d8a-448f-8c6f-3b9ce2fc34e9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:31.695348 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-88bbed74-9d8a-448f-8c6f-3b9ce2fc34e9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:31.751739 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-7feeac78-c985-41de-84ad-bd8aa857ca05 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:31.753065 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-7feeac78-c985-41de-84ad-bd8aa857ca05 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:31.760088 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7feeac78-c985-41de-84ad-bd8aa857ca05 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:31.760955 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7feeac78-c985-41de-84ad-bd8aa857ca05 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:31.761560 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7feeac78-c985-41de-84ad-bd8aa857ca05 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:31.762487 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7feeac78-c985-41de-84ad-bd8aa857ca05 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:31.763154 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7feeac78-c985-41de-84ad-bd8aa857ca05 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:31.763830 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7feeac78-c985-41de-84ad-bd8aa857ca05 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:31.903707 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-88bbed74-9d8a-448f-8c6f-3b9ce2fc34e9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:31.914453 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-88bbed74-9d8a-448f-8c6f-3b9ce2fc34e9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 0.236136 Sep 20 22:24:31.926614 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 59/109] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:31 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:31.938634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-09853853-a321-4cd0-b21f-7a2e1bdea7bf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:31.939616 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-09853853-a321-4cd0-b21f-7a2e1bdea7bf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:31.948709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-09853853-a321-4cd0-b21f-7a2e1bdea7bf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:31.949527 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-09853853-a321-4cd0-b21f-7a2e1bdea7bf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:31.950141 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-09853853-a321-4cd0-b21f-7a2e1bdea7bf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:31.951018 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-09853853-a321-4cd0-b21f-7a2e1bdea7bf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:31.951881 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-09853853-a321-4cd0-b21f-7a2e1bdea7bf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:31.952444 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-09853853-a321-4cd0-b21f-7a2e1bdea7bf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:31.967440 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-7feeac78-c985-41de-84ad-bd8aa857ca05 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:31.976201 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-7feeac78-c985-41de-84ad-bd8aa857ca05 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.229469 Sep 20 22:24:31.985203 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 51/110] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:31 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:32.119221 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-09853853-a321-4cd0-b21f-7a2e1bdea7bf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:32.127463 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-09853853-a321-4cd0-b21f-7a2e1bdea7bf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 0.198813 Sep 20 22:24:32.128033 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 60/111] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:31 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:32.690784 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-894be254-bf23-49f5-b9af-ed979d24441d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:32.691466 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-894be254-bf23-49f5-b9af-ed979d24441d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:32.697581 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-894be254-bf23-49f5-b9af-ed979d24441d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:32.698071 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-894be254-bf23-49f5-b9af-ed979d24441d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:32.698511 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-894be254-bf23-49f5-b9af-ed979d24441d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:32.699205 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-894be254-bf23-49f5-b9af-ed979d24441d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:32.699661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-894be254-bf23-49f5-b9af-ed979d24441d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:32.700084 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-894be254-bf23-49f5-b9af-ed979d24441d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:32.835955 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-894be254-bf23-49f5-b9af-ed979d24441d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:32.844184 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-894be254-bf23-49f5-b9af-ed979d24441d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:32.845685 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-894be254-bf23-49f5-b9af-ed979d24441d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:32.846784 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-894be254-bf23-49f5-b9af-ed979d24441d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1407 microversion: 2.20 time: 0.160503 Sep 20 22:24:32.847343 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 52/112] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:32 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:32.939279 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-00fefe40-b456-485d-9004-33b38a025dc2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:32.940253 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-00fefe40-b456-485d-9004-33b38a025dc2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:32.946555 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-00fefe40-b456-485d-9004-33b38a025dc2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:32.947122 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-00fefe40-b456-485d-9004-33b38a025dc2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:32.947630 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-00fefe40-b456-485d-9004-33b38a025dc2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:32.949245 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-00fefe40-b456-485d-9004-33b38a025dc2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:32.949828 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-00fefe40-b456-485d-9004-33b38a025dc2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:32.950317 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-00fefe40-b456-485d-9004-33b38a025dc2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:32.992410 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-25cd350b-b97b-4a1b-9156-e8c4a9f9938e req-3fe89455-6a75-448c-baf3-1b4695fd8645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84071376-3176-4365-9249-7554ed26b308", "name": "network-vif-plugged", "status": "completed", "tag": "032c0f23-cc75-43ef-9989-eed48c7216a2"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:24:33.014250 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-25cd350b-b97b-4a1b-9156-e8c4a9f9938e req-3fe89455-6a75-448c-baf3-1b4695fd8645 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:33.014734 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-25cd350b-b97b-4a1b-9156-e8c4a9f9938e req-3fe89455-6a75-448c-baf3-1b4695fd8645 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:33.015155 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-25cd350b-b97b-4a1b-9156-e8c4a9f9938e req-3fe89455-6a75-448c-baf3-1b4695fd8645 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:33.027174 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-25cd350b-b97b-4a1b-9156-e8c4a9f9938e req-3fe89455-6a75-448c-baf3-1b4695fd8645 service nova] Creating event network-vif-plugged:032c0f23-cc75-43ef-9989-eed48c7216a2 for instance 84071376-3176-4365-9249-7554ed26b308 on hv-cinder-85827 Sep 20 22:24:33.033359 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-25cd350b-b97b-4a1b-9156-e8c4a9f9938e req-3fe89455-6a75-448c-baf3-1b4695fd8645 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045748 Sep 20 22:24:33.033963 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 53/113] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:24:33.039033 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-9040a681-ab7f-4d94-a70b-eb494bd363b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:33.039722 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-9040a681-ab7f-4d94-a70b-eb494bd363b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:33.046452 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9040a681-ab7f-4d94-a70b-eb494bd363b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:33.046935 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9040a681-ab7f-4d94-a70b-eb494bd363b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:33.047528 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9040a681-ab7f-4d94-a70b-eb494bd363b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:33.048213 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9040a681-ab7f-4d94-a70b-eb494bd363b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:33.048658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9040a681-ab7f-4d94-a70b-eb494bd363b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:33.049099 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9040a681-ab7f-4d94-a70b-eb494bd363b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:33.124628 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-00fefe40-b456-485d-9004-33b38a025dc2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:33.133529 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-00fefe40-b456-485d-9004-33b38a025dc2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 0.198341 Sep 20 22:24:33.134403 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 61/114] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:32 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:33.150882 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-e69640cd-521c-487e-8eb7-d89ca96ec505 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:33.151598 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-e69640cd-521c-487e-8eb7-d89ca96ec505 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:33.158396 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e69640cd-521c-487e-8eb7-d89ca96ec505 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:33.159345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e69640cd-521c-487e-8eb7-d89ca96ec505 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:33.159989 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e69640cd-521c-487e-8eb7-d89ca96ec505 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:33.161088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e69640cd-521c-487e-8eb7-d89ca96ec505 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:33.161856 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e69640cd-521c-487e-8eb7-d89ca96ec505 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:33.162467 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e69640cd-521c-487e-8eb7-d89ca96ec505 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:33.194185 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-9040a681-ab7f-4d94-a70b-eb494bd363b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:33.204520 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-9040a681-ab7f-4d94-a70b-eb494bd363b6 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.169391 Sep 20 22:24:33.205882 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 54/115] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:33 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:33.318196 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-e69640cd-521c-487e-8eb7-d89ca96ec505 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:33.330097 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-e69640cd-521c-487e-8eb7-d89ca96ec505 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 0.183570 Sep 20 22:24:33.330676 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 62/116] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:33 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:33.872370 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d113e58e-4e85-434e-bd57-848c414f6fb7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:33.873009 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d113e58e-4e85-434e-bd57-848c414f6fb7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:33.875655 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:33.880862 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d113e58e-4e85-434e-bd57-848c414f6fb7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:33.881359 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d113e58e-4e85-434e-bd57-848c414f6fb7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:33.881887 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d113e58e-4e85-434e-bd57-848c414f6fb7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:33.882734 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d113e58e-4e85-434e-bd57-848c414f6fb7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:33.883188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d113e58e-4e85-434e-bd57-848c414f6fb7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:33.883771 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d113e58e-4e85-434e-bd57-848c414f6fb7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:34.059460 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-d113e58e-4e85-434e-bd57-848c414f6fb7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:34.068188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-d113e58e-4e85-434e-bd57-848c414f6fb7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:34.070079 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-d113e58e-4e85-434e-bd57-848c414f6fb7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:34.071598 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-d113e58e-4e85-434e-bd57-848c414f6fb7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1407 microversion: 2.20 time: 0.203796 Sep 20 22:24:34.072165 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 55/117] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:33 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:34.157202 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-1f064a4b-a96c-4677-8947-786efc26dd16 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:34.157981 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-1f064a4b-a96c-4677-8947-786efc26dd16 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:34.164079 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1f064a4b-a96c-4677-8947-786efc26dd16 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:34.164558 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1f064a4b-a96c-4677-8947-786efc26dd16 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:34.165067 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1f064a4b-a96c-4677-8947-786efc26dd16 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:34.165699 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1f064a4b-a96c-4677-8947-786efc26dd16 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:34.166135 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1f064a4b-a96c-4677-8947-786efc26dd16 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:34.166753 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1f064a4b-a96c-4677-8947-786efc26dd16 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:34.229846 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-67b3b363-7c78-487f-82fb-331507c1cae9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:34.231261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-67b3b363-7c78-487f-82fb-331507c1cae9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:34.238829 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-67b3b363-7c78-487f-82fb-331507c1cae9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:34.240076 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-67b3b363-7c78-487f-82fb-331507c1cae9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:34.240530 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-67b3b363-7c78-487f-82fb-331507c1cae9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:34.241308 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-67b3b363-7c78-487f-82fb-331507c1cae9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:34.241765 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-67b3b363-7c78-487f-82fb-331507c1cae9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:34.242348 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-67b3b363-7c78-487f-82fb-331507c1cae9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:34.304927 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-1f064a4b-a96c-4677-8947-786efc26dd16 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:34.313616 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-1f064a4b-a96c-4677-8947-786efc26dd16 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1362 microversion: 2.1 time: 0.160738 Sep 20 22:24:34.314280 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 63/118] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:34 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:34.352903 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3b3f645f-4c06-4742-9f87-a008446e0b8c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:34.353739 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-3b3f645f-4c06-4742-9f87-a008446e0b8c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:34.360794 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b3f645f-4c06-4742-9f87-a008446e0b8c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:34.362693 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b3f645f-4c06-4742-9f87-a008446e0b8c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:34.363573 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b3f645f-4c06-4742-9f87-a008446e0b8c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:34.364274 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b3f645f-4c06-4742-9f87-a008446e0b8c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:34.364686 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b3f645f-4c06-4742-9f87-a008446e0b8c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:34.365406 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b3f645f-4c06-4742-9f87-a008446e0b8c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:34.393540 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-67b3b363-7c78-487f-82fb-331507c1cae9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:34.403085 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-67b3b363-7c78-487f-82fb-331507c1cae9 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.177907 Sep 20 22:24:34.403973 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 56/119] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:34 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:34.510707 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3b3f645f-4c06-4742-9f87-a008446e0b8c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:34.519067 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-3b3f645f-4c06-4742-9f87-a008446e0b8c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 0.170155 Sep 20 22:24:34.519673 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 64/120] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:34 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:35.103116 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8ce93a87-d352-4232-8705-b9291cae9306 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:35.104536 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8ce93a87-d352-4232-8705-b9291cae9306 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:35.111462 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8ce93a87-d352-4232-8705-b9291cae9306 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:35.112406 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8ce93a87-d352-4232-8705-b9291cae9306 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:35.113018 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8ce93a87-d352-4232-8705-b9291cae9306 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:35.114365 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8ce93a87-d352-4232-8705-b9291cae9306 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:35.115223 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8ce93a87-d352-4232-8705-b9291cae9306 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:35.115788 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8ce93a87-d352-4232-8705-b9291cae9306 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:35.328846 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-8ce93a87-d352-4232-8705-b9291cae9306 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:35.332025 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=100 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:35.341276 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-8ce93a87-d352-4232-8705-b9291cae9306 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:35.343091 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-8ce93a87-d352-4232-8705-b9291cae9306 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:35.344238 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-8ce93a87-d352-4232-8705-b9291cae9306 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1407 microversion: 2.20 time: 0.249128 Sep 20 22:24:35.344898 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 57/121] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:35 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:35.350180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c8db1a55-4014-4c97-815d-a72e0096b979 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:35.350793 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-c8db1a55-4014-4c97-815d-a72e0096b979 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:35.357716 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c8db1a55-4014-4c97-815d-a72e0096b979 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:35.358257 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c8db1a55-4014-4c97-815d-a72e0096b979 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:35.358629 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c8db1a55-4014-4c97-815d-a72e0096b979 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:35.359318 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c8db1a55-4014-4c97-815d-a72e0096b979 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:35.359768 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c8db1a55-4014-4c97-815d-a72e0096b979 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:35.360176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c8db1a55-4014-4c97-815d-a72e0096b979 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:35.426761 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-5d57a6f1-6f92-4e6d-a0ea-415f36744965 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:35.427449 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-5d57a6f1-6f92-4e6d-a0ea-415f36744965 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:35.436410 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5d57a6f1-6f92-4e6d-a0ea-415f36744965 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:35.438302 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5d57a6f1-6f92-4e6d-a0ea-415f36744965 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:35.439648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5d57a6f1-6f92-4e6d-a0ea-415f36744965 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:35.440444 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5d57a6f1-6f92-4e6d-a0ea-415f36744965 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:35.442133 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5d57a6f1-6f92-4e6d-a0ea-415f36744965 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:35.443901 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5d57a6f1-6f92-4e6d-a0ea-415f36744965 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:35.571037 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-c8db1a55-4014-4c97-815d-a72e0096b979 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:35.585661 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c8db1a55-4014-4c97-815d-a72e0096b979 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1548 microversion: 2.1 time: 0.244429 Sep 20 22:24:35.590022 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 65/122] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:35 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1548 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:35.613451 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c04fbd71-4eac-4590-857d-3aefdc99de9d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:35.619006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-c04fbd71-4eac-4590-857d-3aefdc99de9d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:35.636554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c04fbd71-4eac-4590-857d-3aefdc99de9d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:35.637081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c04fbd71-4eac-4590-857d-3aefdc99de9d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:35.637525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c04fbd71-4eac-4590-857d-3aefdc99de9d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:35.638249 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c04fbd71-4eac-4590-857d-3aefdc99de9d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:35.638688 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c04fbd71-4eac-4590-857d-3aefdc99de9d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:35.639108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c04fbd71-4eac-4590-857d-3aefdc99de9d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:35.667814 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-5d57a6f1-6f92-4e6d-a0ea-415f36744965 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:35.683100 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-5d57a6f1-6f92-4e6d-a0ea-415f36744965 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.256746 Sep 20 22:24:35.700166 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 58/123] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:35 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:35.706210 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-9b757962-6670-4050-a77e-f047d3a005f1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:35.711013 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-9b757962-6670-4050-a77e-f047d3a005f1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:35.726693 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9b757962-6670-4050-a77e-f047d3a005f1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:35.727138 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9b757962-6670-4050-a77e-f047d3a005f1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:35.727640 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9b757962-6670-4050-a77e-f047d3a005f1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:35.732501 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9b757962-6670-4050-a77e-f047d3a005f1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:35.733038 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9b757962-6670-4050-a77e-f047d3a005f1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:35.733682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9b757962-6670-4050-a77e-f047d3a005f1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:35.815226 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-c04fbd71-4eac-4590-857d-3aefdc99de9d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:35.824951 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c04fbd71-4eac-4590-857d-3aefdc99de9d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 0.232402 Sep 20 22:24:35.825570 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 66/124] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:35 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:35.887379 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-9b757962-6670-4050-a77e-f047d3a005f1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188158 Sep 20 22:24:35.888135 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 59/125] 10.222.0.16 () {58 vars in 1275 bytes} [Tue Sep 20 22:24:35 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:24:36.374621 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4f0d36d8-a505-4114-8e85-441b3f21a552 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:36.375229 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4f0d36d8-a505-4114-8e85-441b3f21a552 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:36.381523 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4f0d36d8-a505-4114-8e85-441b3f21a552 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:36.381953 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4f0d36d8-a505-4114-8e85-441b3f21a552 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:36.382388 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4f0d36d8-a505-4114-8e85-441b3f21a552 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:36.383761 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4f0d36d8-a505-4114-8e85-441b3f21a552 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:36.384213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4f0d36d8-a505-4114-8e85-441b3f21a552 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:36.384819 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4f0d36d8-a505-4114-8e85-441b3f21a552 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:36.403615 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=100 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:36.709500 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-24234c8e-b4d2-4b86-9286-def13a723e21 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:36.710067 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-24234c8e-b4d2-4b86-9286-def13a723e21 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:36.717249 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-24234c8e-b4d2-4b86-9286-def13a723e21 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:36.725184 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-24234c8e-b4d2-4b86-9286-def13a723e21 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:36.726157 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-24234c8e-b4d2-4b86-9286-def13a723e21 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:36.727925 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-24234c8e-b4d2-4b86-9286-def13a723e21 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:36.728504 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-24234c8e-b4d2-4b86-9286-def13a723e21 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:36.730047 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-24234c8e-b4d2-4b86-9286-def13a723e21 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:36.897610 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-24234c8e-b4d2-4b86-9286-def13a723e21 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:36.906976 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-24234c8e-b4d2-4b86-9286-def13a723e21 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.201160 Sep 20 22:24:36.908097 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 60/126] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:36 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:36.913657 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-98c338b4-6ad1-40a7-91d2-96a7b113df3d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:36.914488 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-98c338b4-6ad1-40a7-91d2-96a7b113df3d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:36.920663 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-98c338b4-6ad1-40a7-91d2-96a7b113df3d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:36.921545 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-98c338b4-6ad1-40a7-91d2-96a7b113df3d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:36.922223 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-98c338b4-6ad1-40a7-91d2-96a7b113df3d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:36.923126 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-98c338b4-6ad1-40a7-91d2-96a7b113df3d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:36.923766 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-98c338b4-6ad1-40a7-91d2-96a7b113df3d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:36.924279 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-98c338b4-6ad1-40a7-91d2-96a7b113df3d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:36.946654 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4f0d36d8-a505-4114-8e85-441b3f21a552 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:36.958144 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4f0d36d8-a505-4114-8e85-441b3f21a552 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:36.960628 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4f0d36d8-a505-4114-8e85-441b3f21a552 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:36.961910 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4f0d36d8-a505-4114-8e85-441b3f21a552 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1407 microversion: 2.20 time: 0.591909 Sep 20 22:24:36.962705 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 67/127] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:36 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1407 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:37.078435 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-98c338b4-6ad1-40a7-91d2-96a7b113df3d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:37.086008 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-98c338b4-6ad1-40a7-91d2-96a7b113df3d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1321 microversion: 2.1 time: 0.176575 Sep 20 22:24:37.086894 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 61/128] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:36 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:37.741358 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-652c77d0-6a8e-4020-ad8b-b1b8b4733e4a req-6dcfb552-0127-438c-9780-b2c3fe930ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89747cc8-0eba-4b3b-8fec-ec0663bc51d0", "tag": "beceeb78-fe70-47d6-98db-538612768bf8"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:24:37.759814 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-652c77d0-6a8e-4020-ad8b-b1b8b4733e4a req-6dcfb552-0127-438c-9780-b2c3fe930ae8 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:37.760377 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-652c77d0-6a8e-4020-ad8b-b1b8b4733e4a req-6dcfb552-0127-438c-9780-b2c3fe930ae8 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:37.761030 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-652c77d0-6a8e-4020-ad8b-b1b8b4733e4a req-6dcfb552-0127-438c-9780-b2c3fe930ae8 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:37.775930 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-652c77d0-6a8e-4020-ad8b-b1b8b4733e4a req-6dcfb552-0127-438c-9780-b2c3fe930ae8 service nova] Creating event network-changed:beceeb78-fe70-47d6-98db-538612768bf8 for instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 on hv-cinder-85827 Sep 20 22:24:37.783498 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-652c77d0-6a8e-4020-ad8b-b1b8b4733e4a req-6dcfb552-0127-438c-9780-b2c3fe930ae8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046222 Sep 20 22:24:37.788943 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 68/129] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:24:37.930811 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-e2b41d32-e44d-4369-b242-31c4cd9e683f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:37.932264 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-e2b41d32-e44d-4369-b242-31c4cd9e683f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:37.939356 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e2b41d32-e44d-4369-b242-31c4cd9e683f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:37.939956 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e2b41d32-e44d-4369-b242-31c4cd9e683f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:37.940585 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e2b41d32-e44d-4369-b242-31c4cd9e683f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:37.941486 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e2b41d32-e44d-4369-b242-31c4cd9e683f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:37.941935 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e2b41d32-e44d-4369-b242-31c4cd9e683f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:37.942358 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e2b41d32-e44d-4369-b242-31c4cd9e683f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:37.988572 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ade52461-7484-4253-8e27-3cfc831de4de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:37.989323 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ade52461-7484-4253-8e27-3cfc831de4de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:38.013631 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ade52461-7484-4253-8e27-3cfc831de4de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:38.014435 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ade52461-7484-4253-8e27-3cfc831de4de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:38.014877 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ade52461-7484-4253-8e27-3cfc831de4de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:38.015616 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ade52461-7484-4253-8e27-3cfc831de4de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:38.016272 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ade52461-7484-4253-8e27-3cfc831de4de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:38.016703 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ade52461-7484-4253-8e27-3cfc831de4de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:38.193146 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-e2b41d32-e44d-4369-b242-31c4cd9e683f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:38.201508 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-e2b41d32-e44d-4369-b242-31c4cd9e683f tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.274459 Sep 20 22:24:38.202338 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 62/130] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:37 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:38.207323 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ee521363-67fe-467e-bb4a-dd29a547c999 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:38.207931 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ee521363-67fe-467e-bb4a-dd29a547c999 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:38.219891 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ee521363-67fe-467e-bb4a-dd29a547c999 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:38.220388 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ee521363-67fe-467e-bb4a-dd29a547c999 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:38.220880 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ee521363-67fe-467e-bb4a-dd29a547c999 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:38.221685 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ee521363-67fe-467e-bb4a-dd29a547c999 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:38.225124 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ee521363-67fe-467e-bb4a-dd29a547c999 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:38.225633 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ee521363-67fe-467e-bb4a-dd29a547c999 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:38.227320 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ade52461-7484-4253-8e27-3cfc831de4de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:38.236176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ade52461-7484-4253-8e27-3cfc831de4de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:38.237640 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ade52461-7484-4253-8e27-3cfc831de4de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:38.238790 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ade52461-7484-4253-8e27-3cfc831de4de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1407 microversion: 2.20 time: 0.254716 Sep 20 22:24:38.239349 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 69/131] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:37 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:24:38.363471 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ee521363-67fe-467e-bb4a-dd29a547c999 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:38.373982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ee521363-67fe-467e-bb4a-dd29a547c999 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1514 microversion: 2.1 time: 0.170403 Sep 20 22:24:38.374670 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 63/132] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:38 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:38.398468 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-fd7f8d52-0722-4e12-977f-94423bad029d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:24:38.400843 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-fd7f8d52-0722-4e12-977f-94423bad029d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:38.407466 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fd7f8d52-0722-4e12-977f-94423bad029d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:38.408031 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fd7f8d52-0722-4e12-977f-94423bad029d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:38.408658 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fd7f8d52-0722-4e12-977f-94423bad029d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:38.409387 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fd7f8d52-0722-4e12-977f-94423bad029d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:38.409843 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fd7f8d52-0722-4e12-977f-94423bad029d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:38.410266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fd7f8d52-0722-4e12-977f-94423bad029d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:38.472720 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-fd7f8d52-0722-4e12-977f-94423bad029d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lazy-loading 'flavor' on Instance uuid bfc70c4c-17f0-432f-a168-0e8a0cfadf49 {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:24:38.618598 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-fd7f8d52-0722-4e12-977f-94423bad029d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "POST /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49/action" status: 200 len: 32 microversion: 2.1 time: 0.224228 Sep 20 22:24:38.625355 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 70/133] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 20 22:24:38 2022] POST /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49/action => generated 32 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 20 22:24:38.637120 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-377150c2-ba04-453d-bc61-82c4e865fa4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:38.643251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-377150c2-ba04-453d-bc61-82c4e865fa4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:38.656255 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-377150c2-ba04-453d-bc61-82c4e865fa4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:38.656743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-377150c2-ba04-453d-bc61-82c4e865fa4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:38.657217 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-377150c2-ba04-453d-bc61-82c4e865fa4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:38.657941 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-377150c2-ba04-453d-bc61-82c4e865fa4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:38.659494 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-377150c2-ba04-453d-bc61-82c4e865fa4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:38.660097 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-377150c2-ba04-453d-bc61-82c4e865fa4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:38.991188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-377150c2-ba04-453d-bc61-82c4e865fa4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:39.000996 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-377150c2-ba04-453d-bc61-82c4e865fa4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.371941 Sep 20 22:24:39.013905 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 64/134] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:38 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:39.042554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-b7b2a3a8-2abe-4cdd-828a-6689d94e7579 req-1024ceba-940a-4eb8-9588-4d5aa2fe85af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d58779-65b7-4b97-8536-eef4357a475d", "name": "network-vif-plugged", "status": "completed", "tag": "d965769d-834a-4b9f-817a-24e086032c2d"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:24:39.052323 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-b7b2a3a8-2abe-4cdd-828a-6689d94e7579 req-1024ceba-940a-4eb8-9588-4d5aa2fe85af service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:39.052944 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-b7b2a3a8-2abe-4cdd-828a-6689d94e7579 req-1024ceba-940a-4eb8-9588-4d5aa2fe85af service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:39.053487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-b7b2a3a8-2abe-4cdd-828a-6689d94e7579 req-1024ceba-940a-4eb8-9588-4d5aa2fe85af service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:39.064902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-b7b2a3a8-2abe-4cdd-828a-6689d94e7579 req-1024ceba-940a-4eb8-9588-4d5aa2fe85af service nova] Creating event network-vif-plugged:d965769d-834a-4b9f-817a-24e086032c2d for instance 48d58779-65b7-4b97-8536-eef4357a475d on hv-cinder-85827 Sep 20 22:24:39.070135 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-b7b2a3a8-2abe-4cdd-828a-6689d94e7579 req-1024ceba-940a-4eb8-9588-4d5aa2fe85af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033896 Sep 20 22:24:39.070860 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 71/135] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:24:39.231007 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-82f17cc8-5d30-4627-a865-3c891b27187b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:39.232075 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-82f17cc8-5d30-4627-a865-3c891b27187b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:39.242310 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-82f17cc8-5d30-4627-a865-3c891b27187b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:39.243683 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-82f17cc8-5d30-4627-a865-3c891b27187b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:39.244340 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-82f17cc8-5d30-4627-a865-3c891b27187b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:39.245990 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-82f17cc8-5d30-4627-a865-3c891b27187b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:39.247237 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-82f17cc8-5d30-4627-a865-3c891b27187b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:39.247896 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-82f17cc8-5d30-4627-a865-3c891b27187b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:39.266350 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-d983ca8c-b532-4ad1-99aa-84b4bf423a19 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:39.267973 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-d983ca8c-b532-4ad1-99aa-84b4bf423a19 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:39.278170 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d983ca8c-b532-4ad1-99aa-84b4bf423a19 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:39.279378 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d983ca8c-b532-4ad1-99aa-84b4bf423a19 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:39.280264 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d983ca8c-b532-4ad1-99aa-84b4bf423a19 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:39.281486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d983ca8c-b532-4ad1-99aa-84b4bf423a19 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:39.282574 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d983ca8c-b532-4ad1-99aa-84b4bf423a19 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:39.283968 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d983ca8c-b532-4ad1-99aa-84b4bf423a19 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:39.434129 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-82f17cc8-5d30-4627-a865-3c891b27187b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:39.442765 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-82f17cc8-5d30-4627-a865-3c891b27187b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1314 microversion: 2.1 time: 0.219501 Sep 20 22:24:39.443437 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 65/136] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:39 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:39.465198 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-d983ca8c-b532-4ad1-99aa-84b4bf423a19 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:39.474377 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-d983ca8c-b532-4ad1-99aa-84b4bf423a19 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:39.475762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-d983ca8c-b532-4ad1-99aa-84b4bf423a19 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:39.477243 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-d983ca8c-b532-4ad1-99aa-84b4bf423a19 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1407 microversion: 2.20 time: 0.215983 Sep 20 22:24:39.478206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 72/137] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:39 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:40.026075 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-927ca8b3-7701-447a-a7bf-01afe02b02ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:40.027271 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-927ca8b3-7701-447a-a7bf-01afe02b02ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:40.033889 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-927ca8b3-7701-447a-a7bf-01afe02b02ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:40.034879 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-927ca8b3-7701-447a-a7bf-01afe02b02ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:40.035527 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-927ca8b3-7701-447a-a7bf-01afe02b02ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:40.036461 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-927ca8b3-7701-447a-a7bf-01afe02b02ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:40.037058 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-927ca8b3-7701-447a-a7bf-01afe02b02ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:40.037497 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-927ca8b3-7701-447a-a7bf-01afe02b02ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:40.179660 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-927ca8b3-7701-447a-a7bf-01afe02b02ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:40.187995 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-927ca8b3-7701-447a-a7bf-01afe02b02ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.166024 Sep 20 22:24:40.188607 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 66/138] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:40 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:40.467873 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-663945b8-b736-4190-8bb4-20c9d4c13d5d tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:40.468476 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-663945b8-b736-4190-8bb4-20c9d4c13d5d tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:40.477697 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-663945b8-b736-4190-8bb4-20c9d4c13d5d tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:40.478381 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-663945b8-b736-4190-8bb4-20c9d4c13d5d tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:40.478957 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-663945b8-b736-4190-8bb4-20c9d4c13d5d tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:40.479880 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-663945b8-b736-4190-8bb4-20c9d4c13d5d tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:40.480589 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-663945b8-b736-4190-8bb4-20c9d4c13d5d tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:40.481595 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-663945b8-b736-4190-8bb4-20c9d4c13d5d tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:40.503862 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-317da0c5-8f83-480e-8496-25491fd89d3d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:40.504620 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-317da0c5-8f83-480e-8496-25491fd89d3d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:40.511587 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-317da0c5-8f83-480e-8496-25491fd89d3d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:40.512074 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-317da0c5-8f83-480e-8496-25491fd89d3d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:40.512510 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-317da0c5-8f83-480e-8496-25491fd89d3d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:40.513237 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-317da0c5-8f83-480e-8496-25491fd89d3d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:40.513688 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-317da0c5-8f83-480e-8496-25491fd89d3d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:40.514115 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-317da0c5-8f83-480e-8496-25491fd89d3d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:40.644567 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-663945b8-b736-4190-8bb4-20c9d4c13d5d tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:40.656209 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-663945b8-b736-4190-8bb4-20c9d4c13d5d tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1501 microversion: 2.1 time: 0.192542 Sep 20 22:24:40.656797 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 73/139] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:40 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1501 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:40.764623 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-317da0c5-8f83-480e-8496-25491fd89d3d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:40.773956 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-317da0c5-8f83-480e-8496-25491fd89d3d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:40.775555 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-317da0c5-8f83-480e-8496-25491fd89d3d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:40.777444 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-317da0c5-8f83-480e-8496-25491fd89d3d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1407 microversion: 2.20 time: 0.277627 Sep 20 22:24:40.793206 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 67/140] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:40 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:24:41.213975 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-46164bf1-8e66-4f73-b5cb-edb6892849f7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:41.214813 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-46164bf1-8e66-4f73-b5cb-edb6892849f7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:41.222192 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-46164bf1-8e66-4f73-b5cb-edb6892849f7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:41.222752 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-46164bf1-8e66-4f73-b5cb-edb6892849f7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:41.223144 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-46164bf1-8e66-4f73-b5cb-edb6892849f7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:41.224011 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-46164bf1-8e66-4f73-b5cb-edb6892849f7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:41.224625 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-46164bf1-8e66-4f73-b5cb-edb6892849f7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:41.225071 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-46164bf1-8e66-4f73-b5cb-edb6892849f7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:41.378541 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-46164bf1-8e66-4f73-b5cb-edb6892849f7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:41.409494 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-46164bf1-8e66-4f73-b5cb-edb6892849f7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.190974 Sep 20 22:24:41.410183 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 74/141] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:41 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:41.803630 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-e3cbecb8-59aa-43c4-ad4b-8d245e355fdd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:41.804652 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-e3cbecb8-59aa-43c4-ad4b-8d245e355fdd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:41.811262 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e3cbecb8-59aa-43c4-ad4b-8d245e355fdd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:41.812347 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e3cbecb8-59aa-43c4-ad4b-8d245e355fdd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:41.812782 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e3cbecb8-59aa-43c4-ad4b-8d245e355fdd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:41.814004 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e3cbecb8-59aa-43c4-ad4b-8d245e355fdd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:41.814898 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e3cbecb8-59aa-43c4-ad4b-8d245e355fdd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:41.815322 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e3cbecb8-59aa-43c4-ad4b-8d245e355fdd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:42.005826 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-e3cbecb8-59aa-43c4-ad4b-8d245e355fdd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:42.020460 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-e3cbecb8-59aa-43c4-ad4b-8d245e355fdd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:42.022586 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-e3cbecb8-59aa-43c4-ad4b-8d245e355fdd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:42.023758 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-e3cbecb8-59aa-43c4-ad4b-8d245e355fdd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1407 microversion: 2.20 time: 0.224362 Sep 20 22:24:42.024502 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 68/142] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:41 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:42.234811 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-446a79b1-6ae0-444d-94fb-54053fb07d89 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbac5bd9-fc63-4aab-8afa-de4b46af0a2c"}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:24:42.243650 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-446a79b1-6ae0-444d-94fb-54053fb07d89 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:42.264081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-446a79b1-6ae0-444d-94fb-54053fb07d89 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:42.264568 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-446a79b1-6ae0-444d-94fb-54053fb07d89 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:42.267259 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-446a79b1-6ae0-444d-94fb-54053fb07d89 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:42.267979 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-446a79b1-6ae0-444d-94fb-54053fb07d89 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:42.268444 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-446a79b1-6ae0-444d-94fb-54053fb07d89 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:42.268890 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-446a79b1-6ae0-444d-94fb-54053fb07d89 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:42.435454 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c69c8c9e-a637-4fa7-b068-acd89a399b92 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:42.436072 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c69c8c9e-a637-4fa7-b068-acd89a399b92 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:42.442488 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c69c8c9e-a637-4fa7-b068-acd89a399b92 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:42.443384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c69c8c9e-a637-4fa7-b068-acd89a399b92 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:42.444012 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c69c8c9e-a637-4fa7-b068-acd89a399b92 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:42.444897 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c69c8c9e-a637-4fa7-b068-acd89a399b92 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:42.445581 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c69c8c9e-a637-4fa7-b068-acd89a399b92 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:42.446413 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c69c8c9e-a637-4fa7-b068-acd89a399b92 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:42.656649 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c69c8c9e-a637-4fa7-b068-acd89a399b92 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:42.667611 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-c69c8c9e-a637-4fa7-b068-acd89a399b92 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.236757 Sep 20 22:24:42.668261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 69/143] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:42 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:42.733589 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-446a79b1-6ae0-444d-94fb-54053fb07d89 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "POST /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515578 Sep 20 22:24:42.737013 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 75/144] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 20 22:24:42 2022] POST /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308/os-volume_attachments => generated 194 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:24:43.050503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-4daf2f2c-961f-46e8-bb97-c2430513b10e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:43.052040 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-4daf2f2c-961f-46e8-bb97-c2430513b10e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:43.067367 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4daf2f2c-961f-46e8-bb97-c2430513b10e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:43.068100 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4daf2f2c-961f-46e8-bb97-c2430513b10e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:43.068942 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4daf2f2c-961f-46e8-bb97-c2430513b10e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:43.070220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4daf2f2c-961f-46e8-bb97-c2430513b10e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:43.071127 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4daf2f2c-961f-46e8-bb97-c2430513b10e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:43.071762 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4daf2f2c-961f-46e8-bb97-c2430513b10e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:43.227554 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-4daf2f2c-961f-46e8-bb97-c2430513b10e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:43.240315 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-4daf2f2c-961f-46e8-bb97-c2430513b10e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:43.242605 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-4daf2f2c-961f-46e8-bb97-c2430513b10e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:43.244180 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-4daf2f2c-961f-46e8-bb97-c2430513b10e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1598 microversion: 2.20 time: 0.198079 Sep 20 22:24:43.245358 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 70/145] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:24:43 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1598 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:24:43.276861 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-8fb0d525-218f-4b3c-b072-c5079e5af26f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:43.278187 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-8fb0d525-218f-4b3c-b072-c5079e5af26f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:43.285882 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8fb0d525-218f-4b3c-b072-c5079e5af26f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:43.286358 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8fb0d525-218f-4b3c-b072-c5079e5af26f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:43.286957 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8fb0d525-218f-4b3c-b072-c5079e5af26f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:43.287798 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8fb0d525-218f-4b3c-b072-c5079e5af26f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:43.288391 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8fb0d525-218f-4b3c-b072-c5079e5af26f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:43.288983 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8fb0d525-218f-4b3c-b072-c5079e5af26f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:43.381878 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-8fb0d525-218f-4b3c-b072-c5079e5af26f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.109564 Sep 20 22:24:43.382787 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 76/146] 10.222.0.16 () {60 vars in 1316 bytes} [Tue Sep 20 22:24:43 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:24:43.693882 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-e70089b4-a04a-492e-8b0c-7bd29d0b9f73 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:43.696269 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-e70089b4-a04a-492e-8b0c-7bd29d0b9f73 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:43.705749 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e70089b4-a04a-492e-8b0c-7bd29d0b9f73 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:43.710447 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e70089b4-a04a-492e-8b0c-7bd29d0b9f73 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:43.711064 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e70089b4-a04a-492e-8b0c-7bd29d0b9f73 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:43.712111 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e70089b4-a04a-492e-8b0c-7bd29d0b9f73 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:43.713407 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e70089b4-a04a-492e-8b0c-7bd29d0b9f73 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:43.713988 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e70089b4-a04a-492e-8b0c-7bd29d0b9f73 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:44.414185 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-e70089b4-a04a-492e-8b0c-7bd29d0b9f73 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:44.437310 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-e70089b4-a04a-492e-8b0c-7bd29d0b9f73 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.748728 Sep 20 22:24:44.439359 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 71/147] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:43 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:45.474403 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a44491ae-84c2-466b-80bc-ac7bc350a9e1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:45.475854 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a44491ae-84c2-466b-80bc-ac7bc350a9e1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:45.483888 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a44491ae-84c2-466b-80bc-ac7bc350a9e1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:45.484612 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a44491ae-84c2-466b-80bc-ac7bc350a9e1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:45.485402 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a44491ae-84c2-466b-80bc-ac7bc350a9e1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:45.486275 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a44491ae-84c2-466b-80bc-ac7bc350a9e1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:45.486905 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a44491ae-84c2-466b-80bc-ac7bc350a9e1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:45.487481 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a44491ae-84c2-466b-80bc-ac7bc350a9e1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:45.705343 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-b83264dc-0709-4a15-85f0-02f89f6b621a req-e974a7ab-343a-4b49-916c-41e749c1d78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d58779-65b7-4b97-8536-eef4357a475d", "tag": "d965769d-834a-4b9f-817a-24e086032c2d"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:24:45.706822 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a44491ae-84c2-466b-80bc-ac7bc350a9e1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:45.716509 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a44491ae-84c2-466b-80bc-ac7bc350a9e1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.250618 Sep 20 22:24:45.734165 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 77/148] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:45 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:45.750458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-b83264dc-0709-4a15-85f0-02f89f6b621a req-e974a7ab-343a-4b49-916c-41e749c1d78b service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:45.751194 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-b83264dc-0709-4a15-85f0-02f89f6b621a req-e974a7ab-343a-4b49-916c-41e749c1d78b service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:45.753575 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-b83264dc-0709-4a15-85f0-02f89f6b621a req-e974a7ab-343a-4b49-916c-41e749c1d78b service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:45.769024 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-b83264dc-0709-4a15-85f0-02f89f6b621a req-e974a7ab-343a-4b49-916c-41e749c1d78b service nova] Creating event network-changed:d965769d-834a-4b9f-817a-24e086032c2d for instance 48d58779-65b7-4b97-8536-eef4357a475d on hv-cinder-85827 Sep 20 22:24:45.775297 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-b83264dc-0709-4a15-85f0-02f89f6b621a req-e974a7ab-343a-4b49-916c-41e749c1d78b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074668 Sep 20 22:24:45.777271 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 72/149] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:24:46.741054 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5f2cb4d1-5211-4be5-993f-3a91b288d150 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:46.742328 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5f2cb4d1-5211-4be5-993f-3a91b288d150 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:46.749909 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=92 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:46.752632 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5f2cb4d1-5211-4be5-993f-3a91b288d150 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:46.753538 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5f2cb4d1-5211-4be5-993f-3a91b288d150 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:46.754149 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5f2cb4d1-5211-4be5-993f-3a91b288d150 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:46.755080 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5f2cb4d1-5211-4be5-993f-3a91b288d150 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:46.755678 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5f2cb4d1-5211-4be5-993f-3a91b288d150 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:46.756244 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5f2cb4d1-5211-4be5-993f-3a91b288d150 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:46.935273 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-5f2cb4d1-5211-4be5-993f-3a91b288d150 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:46.943499 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5f2cb4d1-5211-4be5-993f-3a91b288d150 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.207256 Sep 20 22:24:46.943581 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 78/150] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:46 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:47.967649 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ac295fc4-2ffb-4ead-999f-c4887b7952a9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:47.968369 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ac295fc4-2ffb-4ead-999f-c4887b7952a9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:47.974517 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ac295fc4-2ffb-4ead-999f-c4887b7952a9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:47.975001 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ac295fc4-2ffb-4ead-999f-c4887b7952a9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:47.975436 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ac295fc4-2ffb-4ead-999f-c4887b7952a9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:47.976129 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ac295fc4-2ffb-4ead-999f-c4887b7952a9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:47.976581 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ac295fc4-2ffb-4ead-999f-c4887b7952a9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:47.977387 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ac295fc4-2ffb-4ead-999f-c4887b7952a9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:48.150172 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ac295fc4-2ffb-4ead-999f-c4887b7952a9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:48.159395 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ac295fc4-2ffb-4ead-999f-c4887b7952a9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.196940 Sep 20 22:24:48.159964 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 73/151] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:47 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:49.182264 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ef56561a-75d7-40b2-b40f-7d5cfc291189 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:49.182886 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ef56561a-75d7-40b2-b40f-7d5cfc291189 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:49.189522 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ef56561a-75d7-40b2-b40f-7d5cfc291189 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:49.190016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ef56561a-75d7-40b2-b40f-7d5cfc291189 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:49.190457 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ef56561a-75d7-40b2-b40f-7d5cfc291189 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:49.191161 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ef56561a-75d7-40b2-b40f-7d5cfc291189 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:49.191956 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ef56561a-75d7-40b2-b40f-7d5cfc291189 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:49.192287 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ef56561a-75d7-40b2-b40f-7d5cfc291189 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:49.333680 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ef56561a-75d7-40b2-b40f-7d5cfc291189 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:49.341962 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ef56561a-75d7-40b2-b40f-7d5cfc291189 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.163630 Sep 20 22:24:49.342738 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 79/152] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:49 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:50.365966 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-9376fa89-e166-4963-870c-b23d85d6703a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:50.366636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-9376fa89-e166-4963-870c-b23d85d6703a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:50.374040 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9376fa89-e166-4963-870c-b23d85d6703a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:50.374877 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9376fa89-e166-4963-870c-b23d85d6703a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:50.375465 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9376fa89-e166-4963-870c-b23d85d6703a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:50.376395 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9376fa89-e166-4963-870c-b23d85d6703a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:50.377310 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9376fa89-e166-4963-870c-b23d85d6703a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:50.377926 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9376fa89-e166-4963-870c-b23d85d6703a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:50.525230 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-9376fa89-e166-4963-870c-b23d85d6703a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:50.533746 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-9376fa89-e166-4963-870c-b23d85d6703a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.172804 Sep 20 22:24:50.534332 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 74/153] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:50 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:51.556419 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-65a1fd7c-a032-49b0-ab1b-250c3c80bb43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:51.558303 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-65a1fd7c-a032-49b0-ab1b-250c3c80bb43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:51.564799 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-65a1fd7c-a032-49b0-ab1b-250c3c80bb43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:51.565521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-65a1fd7c-a032-49b0-ab1b-250c3c80bb43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:51.566162 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-65a1fd7c-a032-49b0-ab1b-250c3c80bb43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:51.566857 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-65a1fd7c-a032-49b0-ab1b-250c3c80bb43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:51.567466 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-65a1fd7c-a032-49b0-ab1b-250c3c80bb43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:51.567885 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-65a1fd7c-a032-49b0-ab1b-250c3c80bb43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:51.762923 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-65a1fd7c-a032-49b0-ab1b-250c3c80bb43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:51.771773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-65a1fd7c-a032-49b0-ab1b-250c3c80bb43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.218328 Sep 20 22:24:51.788346 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 80/154] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:51 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:52.795914 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-79214d5f-7823-4a69-a55c-686258578b14 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:52.796677 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-79214d5f-7823-4a69-a55c-686258578b14 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:52.802702 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-79214d5f-7823-4a69-a55c-686258578b14 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:52.803264 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-79214d5f-7823-4a69-a55c-686258578b14 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:52.803757 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-79214d5f-7823-4a69-a55c-686258578b14 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:52.804636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-79214d5f-7823-4a69-a55c-686258578b14 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:52.805192 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-79214d5f-7823-4a69-a55c-686258578b14 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:52.805844 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-79214d5f-7823-4a69-a55c-686258578b14 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:52.832264 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=100 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:52.943304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-6b1973e5-a38e-45da-98b5-55e6e17cf7dd tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:52.944905 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-6b1973e5-a38e-45da-98b5-55e6e17cf7dd tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:52.953704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6b1973e5-a38e-45da-98b5-55e6e17cf7dd tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:52.954742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6b1973e5-a38e-45da-98b5-55e6e17cf7dd tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:52.956297 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6b1973e5-a38e-45da-98b5-55e6e17cf7dd tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:52.957309 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6b1973e5-a38e-45da-98b5-55e6e17cf7dd tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:52.958545 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6b1973e5-a38e-45da-98b5-55e6e17cf7dd tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:52.959212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6b1973e5-a38e-45da-98b5-55e6e17cf7dd tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:53.000920 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-6b1973e5-a38e-45da-98b5-55e6e17cf7dd tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Going to try to terminate instance {{(pid=120474) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:24:53.006269 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-79214d5f-7823-4a69-a55c-686258578b14 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:53.014111 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-79214d5f-7823-4a69-a55c-686258578b14 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.223061 Sep 20 22:24:53.016324 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 75/155] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:52 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:53.043731 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:53.117927 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-6b1973e5-a38e-45da-98b5-55e6e17cf7dd tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "DELETE /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 204 len: 0 microversion: 2.1 time: 0.178493 Sep 20 22:24:53.118517 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 81/156] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:24:52 2022] DELETE /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 20 22:24:53.127566 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-61da5f3c-2d7b-4b42-b7de-63d5f5ccc4b2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:53.128173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-61da5f3c-2d7b-4b42-b7de-63d5f5ccc4b2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:53.135009 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-61da5f3c-2d7b-4b42-b7de-63d5f5ccc4b2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:53.135521 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-61da5f3c-2d7b-4b42-b7de-63d5f5ccc4b2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:53.136004 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-61da5f3c-2d7b-4b42-b7de-63d5f5ccc4b2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:53.136892 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-61da5f3c-2d7b-4b42-b7de-63d5f5ccc4b2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:53.137382 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-61da5f3c-2d7b-4b42-b7de-63d5f5ccc4b2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:53.137987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-61da5f3c-2d7b-4b42-b7de-63d5f5ccc4b2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:53.284141 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-61da5f3c-2d7b-4b42-b7de-63d5f5ccc4b2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:53.292866 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-61da5f3c-2d7b-4b42-b7de-63d5f5ccc4b2 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1553 microversion: 2.1 time: 0.169252 Sep 20 22:24:53.294621 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 76/157] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:53 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:53.452880 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-fddc8ef7-80db-4e32-b4c8-b7b784097753 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1550120868", "imageRef": "a1be001e-c2e4-44b7-b0d2-af96de3855c4", "flavorRef": "452", "networks": [{"uuid": "2bd54fcb-74c2-45c9-8873-bedb4ef2c0ab"}]}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:24:53.514912 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.network.neutron [None req-fddc8ef7-80db-4e32-b4c8-b7b784097753 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] validate_networks() for [('2bd54fcb-74c2-45c9-8873-bedb4ef2c0ab', None, None, None, None, None)] {{(pid=120474) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:24:53.920289 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-fddc8ef7-80db-4e32-b4c8-b7b784097753 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Flavor limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:24:53.920719 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-fddc8ef7-80db-4e32-b4c8-b7b784097753 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Image limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:24:53.921230 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-fddc8ef7-80db-4e32-b4c8-b7b784097753 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Flavor pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:24:53.921777 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-fddc8ef7-80db-4e32-b4c8-b7b784097753 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Image pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:24:53.922192 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-fddc8ef7-80db-4e32-b4c8-b7b784097753 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:24:53.935015 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fddc8ef7-80db-4e32-b4c8-b7b784097753 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:53.935530 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fddc8ef7-80db-4e32-b4c8-b7b784097753 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:53.936006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fddc8ef7-80db-4e32-b4c8-b7b784097753 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:53.937163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fddc8ef7-80db-4e32-b4c8-b7b784097753 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:53.937660 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fddc8ef7-80db-4e32-b4c8-b7b784097753 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:53.938074 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fddc8ef7-80db-4e32-b4c8-b7b784097753 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:53.958596 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-fddc8ef7-80db-4e32-b4c8-b7b784097753 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Getting quotas for project fe8853cc9fd0482097a5ac65534d5e58. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:24:53.964789 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-fddc8ef7-80db-4e32-b4c8-b7b784097753 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Getting quotas for user 9ff864b8e1434ff895ad20c1615dd328 and project fe8853cc9fd0482097a5ac65534d5e58. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:24:53.976544 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-fddc8ef7-80db-4e32-b4c8-b7b784097753 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Going to run 1 instances... {{(pid=120474) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:24:53.980601 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-fddc8ef7-80db-4e32-b4c8-b7b784097753 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a1be001e-c2e4-44b7-b0d2-af96de3855c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:24:54.035503 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-fddc8ef7-80db-4e32-b4c8-b7b784097753 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587451 Sep 20 22:24:54.036066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 82/158] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:24:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 22:24:54.040314 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-5c4297e9-a9d1-4e42-a48b-065bf17b7e7a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:54.041706 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-5c4297e9-a9d1-4e42-a48b-065bf17b7e7a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:54.048940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5c4297e9-a9d1-4e42-a48b-065bf17b7e7a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:54.049703 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5c4297e9-a9d1-4e42-a48b-065bf17b7e7a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:54.050533 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5c4297e9-a9d1-4e42-a48b-065bf17b7e7a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:54.051697 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5c4297e9-a9d1-4e42-a48b-065bf17b7e7a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:54.052636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5c4297e9-a9d1-4e42-a48b-065bf17b7e7a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:54.053933 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-331671d6-6de8-4699-a400-da827738749e tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:54.057267 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-331671d6-6de8-4699-a400-da827738749e tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:54.066647 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5c4297e9-a9d1-4e42-a48b-065bf17b7e7a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:54.128581 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-331671d6-6de8-4699-a400-da827738749e tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:54.138278 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-331671d6-6de8-4699-a400-da827738749e tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e" status: 200 len: 1214 microversion: 2.1 time: 0.092604 Sep 20 22:24:54.139286 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 83/159] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:54 2022] GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:54.230053 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-5c4297e9-a9d1-4e42-a48b-065bf17b7e7a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:54.240802 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-5c4297e9-a9d1-4e42-a48b-065bf17b7e7a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.204478 Sep 20 22:24:54.241797 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 77/160] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:54 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:54.317312 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a8b48392-e172-4ded-a242-36fb1918aec7 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:54.318233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a8b48392-e172-4ded-a242-36fb1918aec7 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:54.325466 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a8b48392-e172-4ded-a242-36fb1918aec7 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:54.326182 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a8b48392-e172-4ded-a242-36fb1918aec7 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:54.326732 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a8b48392-e172-4ded-a242-36fb1918aec7 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:54.327681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a8b48392-e172-4ded-a242-36fb1918aec7 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:54.328323 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a8b48392-e172-4ded-a242-36fb1918aec7 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:54.328905 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a8b48392-e172-4ded-a242-36fb1918aec7 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:54.509437 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a8b48392-e172-4ded-a242-36fb1918aec7 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:54.531918 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a8b48392-e172-4ded-a242-36fb1918aec7 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1553 microversion: 2.1 time: 0.218481 Sep 20 22:24:54.532608 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 84/161] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:54 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1553 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:55.167777 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-f9d5e6eb-cd1e-4bd8-adf2-8d1221a539a3 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:55.168414 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-f9d5e6eb-cd1e-4bd8-adf2-8d1221a539a3 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:55.175025 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f9d5e6eb-cd1e-4bd8-adf2-8d1221a539a3 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:55.175505 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f9d5e6eb-cd1e-4bd8-adf2-8d1221a539a3 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:55.175930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f9d5e6eb-cd1e-4bd8-adf2-8d1221a539a3 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:55.176803 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f9d5e6eb-cd1e-4bd8-adf2-8d1221a539a3 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:55.177287 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f9d5e6eb-cd1e-4bd8-adf2-8d1221a539a3 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:55.177704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f9d5e6eb-cd1e-4bd8-adf2-8d1221a539a3 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:55.263788 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-67c5f8eb-b64f-4feb-96cf-e4f4c5183544 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:55.264393 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-67c5f8eb-b64f-4feb-96cf-e4f4c5183544 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:55.269201 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f9d5e6eb-cd1e-4bd8-adf2-8d1221a539a3 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:55.278449 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-f9d5e6eb-cd1e-4bd8-adf2-8d1221a539a3 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e" status: 200 len: 1266 microversion: 2.1 time: 0.119913 Sep 20 22:24:55.279007 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 78/162] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:55 2022] GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e => generated 1266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:55.286087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-67c5f8eb-b64f-4feb-96cf-e4f4c5183544 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:55.286087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-67c5f8eb-b64f-4feb-96cf-e4f4c5183544 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:55.286087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-67c5f8eb-b64f-4feb-96cf-e4f4c5183544 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:55.286087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-67c5f8eb-b64f-4feb-96cf-e4f4c5183544 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:55.286697 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-67c5f8eb-b64f-4feb-96cf-e4f4c5183544 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:55.286697 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-67c5f8eb-b64f-4feb-96cf-e4f4c5183544 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:55.434736 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-67c5f8eb-b64f-4feb-96cf-e4f4c5183544 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:55.442671 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-67c5f8eb-b64f-4feb-96cf-e4f4c5183544 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.182879 Sep 20 22:24:55.443237 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 85/163] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:55 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:55.559157 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-223e47c3-d792-4b97-bb7c-6f7fd5709dca tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:55.559781 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-223e47c3-d792-4b97-bb7c-6f7fd5709dca tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:55.566012 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-223e47c3-d792-4b97-bb7c-6f7fd5709dca tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:55.566503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-223e47c3-d792-4b97-bb7c-6f7fd5709dca tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:55.566931 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-223e47c3-d792-4b97-bb7c-6f7fd5709dca tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:55.568010 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-223e47c3-d792-4b97-bb7c-6f7fd5709dca tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:55.568543 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-223e47c3-d792-4b97-bb7c-6f7fd5709dca tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:55.569060 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-223e47c3-d792-4b97-bb7c-6f7fd5709dca tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:55.818270 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-223e47c3-d792-4b97-bb7c-6f7fd5709dca tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:55.827128 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-223e47c3-d792-4b97-bb7c-6f7fd5709dca tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1553 microversion: 2.1 time: 0.271973 Sep 20 22:24:55.827768 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 79/164] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:55 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1553 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:56.136170 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-649c50ed-aea2-4321-b542-91d73bf30e3f req-7a60e23b-13b2-4753-b618-380457c76cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84071376-3176-4365-9249-7554ed26b308", "name": "network-vif-deleted", "tag": "032c0f23-cc75-43ef-9989-eed48c7216a2"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:24:56.155990 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-649c50ed-aea2-4321-b542-91d73bf30e3f req-7a60e23b-13b2-4753-b618-380457c76cd5 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:56.156645 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-649c50ed-aea2-4321-b542-91d73bf30e3f req-7a60e23b-13b2-4753-b618-380457c76cd5 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:56.157242 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-649c50ed-aea2-4321-b542-91d73bf30e3f req-7a60e23b-13b2-4753-b618-380457c76cd5 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:56.170237 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-649c50ed-aea2-4321-b542-91d73bf30e3f req-7a60e23b-13b2-4753-b618-380457c76cd5 service nova] Creating event network-vif-deleted:032c0f23-cc75-43ef-9989-eed48c7216a2 for instance 84071376-3176-4365-9249-7554ed26b308 on hv-cinder-85827 Sep 20 22:24:56.175739 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-649c50ed-aea2-4321-b542-91d73bf30e3f req-7a60e23b-13b2-4753-b618-380457c76cd5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043305 Sep 20 22:24:56.176609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 86/165] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:24:56.301553 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b2f66cee-661c-4de6-bfe5-eb8e9ba02c34 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:56.302171 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b2f66cee-661c-4de6-bfe5-eb8e9ba02c34 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:56.309701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b2f66cee-661c-4de6-bfe5-eb8e9ba02c34 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:56.310188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b2f66cee-661c-4de6-bfe5-eb8e9ba02c34 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:56.310616 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b2f66cee-661c-4de6-bfe5-eb8e9ba02c34 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:56.311306 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b2f66cee-661c-4de6-bfe5-eb8e9ba02c34 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:56.311751 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b2f66cee-661c-4de6-bfe5-eb8e9ba02c34 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:56.312169 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b2f66cee-661c-4de6-bfe5-eb8e9ba02c34 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:56.392459 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9b757002-df8c-4fa7-918b-d736cb771a91 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1639141819", "imageRef": "a1be001e-c2e4-44b7-b0d2-af96de3855c4", "flavorRef": "452"}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:24:56.419434 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b2f66cee-661c-4de6-bfe5-eb8e9ba02c34 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:56.427306 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b2f66cee-661c-4de6-bfe5-eb8e9ba02c34 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e" status: 200 len: 1272 microversion: 2.1 time: 0.129692 Sep 20 22:24:56.427883 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 80/166] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:56 2022] GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e => generated 1272 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:56.467388 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-744e9b02-a329-4cb9-a318-b36ca302c014 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:56.468473 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-744e9b02-a329-4cb9-a318-b36ca302c014 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:56.472520 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.network.neutron [None req-9b757002-df8c-4fa7-918b-d736cb771a91 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] validate_networks() for None {{(pid=120474) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:24:56.476906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-744e9b02-a329-4cb9-a318-b36ca302c014 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:56.478128 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-744e9b02-a329-4cb9-a318-b36ca302c014 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:56.479344 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-744e9b02-a329-4cb9-a318-b36ca302c014 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:56.480198 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-744e9b02-a329-4cb9-a318-b36ca302c014 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:56.480724 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-744e9b02-a329-4cb9-a318-b36ca302c014 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:56.481321 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-744e9b02-a329-4cb9-a318-b36ca302c014 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:56.691744 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-744e9b02-a329-4cb9-a318-b36ca302c014 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:56.703014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-744e9b02-a329-4cb9-a318-b36ca302c014 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.239318 Sep 20 22:24:56.704227 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 81/167] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:56 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:56.855254 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8ad2fff0-20a1-4be6-a9cc-2b7c8a923234 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:56.856631 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8ad2fff0-20a1-4be6-a9cc-2b7c8a923234 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:56.865866 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8ad2fff0-20a1-4be6-a9cc-2b7c8a923234 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:56.866973 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8ad2fff0-20a1-4be6-a9cc-2b7c8a923234 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:56.867581 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8ad2fff0-20a1-4be6-a9cc-2b7c8a923234 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:56.871457 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8ad2fff0-20a1-4be6-a9cc-2b7c8a923234 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:56.873189 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8ad2fff0-20a1-4be6-a9cc-2b7c8a923234 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:56.874324 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8ad2fff0-20a1-4be6-a9cc-2b7c8a923234 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:56.910834 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-9b757002-df8c-4fa7-918b-d736cb771a91 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Flavor limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:24:56.911256 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-9b757002-df8c-4fa7-918b-d736cb771a91 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Image limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:24:56.911732 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-9b757002-df8c-4fa7-918b-d736cb771a91 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Flavor pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:24:56.912725 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-9b757002-df8c-4fa7-918b-d736cb771a91 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Image pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:24:56.912725 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-9b757002-df8c-4fa7-918b-d736cb771a91 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:24:56.930408 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8ad2fff0-20a1-4be6-a9cc-2b7c8a923234 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:56.931171 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8ad2fff0-20a1-4be6-a9cc-2b7c8a923234 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:56.932527 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8ad2fff0-20a1-4be6-a9cc-2b7c8a923234 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:56.933240 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-8ad2fff0-20a1-4be6-a9cc-2b7c8a923234 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lazy-loading 'fault' on Instance uuid 84071376-3176-4365-9249-7554ed26b308 {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:24:56.935072 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9b757002-df8c-4fa7-918b-d736cb771a91 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:56.935572 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9b757002-df8c-4fa7-918b-d736cb771a91 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:56.936005 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9b757002-df8c-4fa7-918b-d736cb771a91 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:56.936734 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9b757002-df8c-4fa7-918b-d736cb771a91 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:56.937282 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9b757002-df8c-4fa7-918b-d736cb771a91 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:56.937711 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9b757002-df8c-4fa7-918b-d736cb771a91 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:56.975083 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-9b757002-df8c-4fa7-918b-d736cb771a91 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Getting quotas for project d30f356aca02448f8dbbf8c1d190259f. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:24:56.980022 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-9b757002-df8c-4fa7-918b-d736cb771a91 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Getting quotas for user 0900b908cdb94ccb9c577d814d852fe7 and project d30f356aca02448f8dbbf8c1d190259f. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:24:56.991974 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-8ad2fff0-20a1-4be6-a9cc-2b7c8a923234 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f19d4f5e6243bab3819c7e609f534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022e19ae817e4fb9b0eda463455c2ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:56.993143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9b757002-df8c-4fa7-918b-d736cb771a91 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Going to run 1 instances... {{(pid=120474) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:24:56.996601 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9b757002-df8c-4fa7-918b-d736cb771a91 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] [instance: 073337e5-2eca-4195-a350-435ee3ff2fe7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a1be001e-c2e4-44b7-b0d2-af96de3855c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:24:57.001825 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-8ad2fff0-20a1-4be6-a9cc-2b7c8a923234 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 200 len: 1350 microversion: 2.1 time: 0.152759 Sep 20 22:24:57.003282 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 82/168] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:56 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:57.059312 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-9b757002-df8c-4fa7-918b-d736cb771a91 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671614 Sep 20 22:24:57.060745 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 87/169] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:24:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 20 22:24:57.072384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0d7900bb-ec88-491f-80cb-6b240abb4757 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:57.073536 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-0d7900bb-ec88-491f-80cb-6b240abb4757 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] [instance: 073337e5-2eca-4195-a350-435ee3ff2fe7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:57.162687 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-0d7900bb-ec88-491f-80cb-6b240abb4757 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0900b908cdb94ccb9c577d814d852fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f356aca02448f8dbbf8c1d190259f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:57.175778 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-0d7900bb-ec88-491f-80cb-6b240abb4757 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] 10.222.0.16 "GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7" status: 200 len: 1215 microversion: 2.1 time: 0.108052 Sep 20 22:24:57.176397 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 83/170] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:57 2022] GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7 => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:57.452801 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-bd87a6a7-22dd-4ddf-9787-b4e28e41055f tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:57.453549 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-bd87a6a7-22dd-4ddf-9787-b4e28e41055f tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:57.461942 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bd87a6a7-22dd-4ddf-9787-b4e28e41055f tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:57.463318 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bd87a6a7-22dd-4ddf-9787-b4e28e41055f tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:57.463964 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bd87a6a7-22dd-4ddf-9787-b4e28e41055f tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:57.465869 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bd87a6a7-22dd-4ddf-9787-b4e28e41055f tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:57.466941 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bd87a6a7-22dd-4ddf-9787-b4e28e41055f tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:57.468571 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bd87a6a7-22dd-4ddf-9787-b4e28e41055f tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:57.734340 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-3b8e9f8f-9459-477e-8a19-74eee188ef06 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:57.735091 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-3b8e9f8f-9459-477e-8a19-74eee188ef06 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:57.746513 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3b8e9f8f-9459-477e-8a19-74eee188ef06 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:57.747280 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3b8e9f8f-9459-477e-8a19-74eee188ef06 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:57.750477 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3b8e9f8f-9459-477e-8a19-74eee188ef06 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:57.751381 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3b8e9f8f-9459-477e-8a19-74eee188ef06 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:57.752004 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3b8e9f8f-9459-477e-8a19-74eee188ef06 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:57.752829 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3b8e9f8f-9459-477e-8a19-74eee188ef06 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:57.858167 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-bd87a6a7-22dd-4ddf-9787-b4e28e41055f tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:57.881875 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-bd87a6a7-22dd-4ddf-9787-b4e28e41055f tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e" status: 200 len: 1314 microversion: 2.1 time: 0.433690 Sep 20 22:24:57.882950 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 88/171] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:57 2022] GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:57.956179 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-3b8e9f8f-9459-477e-8a19-74eee188ef06 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:57.973387 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-3b8e9f8f-9459-477e-8a19-74eee188ef06 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.244803 Sep 20 22:24:57.974018 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 84/172] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:57 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:58.029139 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-21097866-4fb9-4441-b475-d2ae56d32723 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:58.030090 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-21097866-4fb9-4441-b475-d2ae56d32723 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:58.038221 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-21097866-4fb9-4441-b475-d2ae56d32723 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:58.038959 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-21097866-4fb9-4441-b475-d2ae56d32723 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:58.039602 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-21097866-4fb9-4441-b475-d2ae56d32723 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:58.040577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-21097866-4fb9-4441-b475-d2ae56d32723 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:58.041549 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-21097866-4fb9-4441-b475-d2ae56d32723 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:58.042418 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-21097866-4fb9-4441-b475-d2ae56d32723 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:58.060054 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-21097866-4fb9-4441-b475-d2ae56d32723 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] HTTP exception thrown: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-21097866-4fb9-4441-b475-d2ae56d32723 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Request method failure captured: Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 HTTP/1.1 Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj16djqYGzg6jdvbRT9Qqbut5WIgEKbS4fs5BVT6z9rLsJ-Q2HFHAL6B8vmzZA8deHN5ZLDNUGZpfokusIMxZAHpEW25K_byB1oab1_v-F0TeaUVY8sZnAlYvxXtc9EmQ1uTbXS5yAoj4_LRQCXqoMBrdn75f3fd1By8kBIPRqhDmuY Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 022e19ae817e4fb9b0eda463455c2ccf Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-DeleteServersTestJSON-2061486758 Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:24:58.076231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:24:58.077697 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/022e19ae817e4fb9b0eda463455c2ccf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_022e19ae817e4fb9b0eda463455c2ccf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/022e19ae817e4fb9b0eda463455c2ccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/022e19ae817e4fb9b0eda463455c2ccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:24:58.077697 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-DeleteServersTestJSON-2061486758 Sep 20 22:24:58.077697 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 022e19ae817e4fb9b0eda463455c2ccf Sep 20 22:24:58.077697 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-DeleteServersTestJSON-2061486758 Sep 20 22:24:58.077697 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-DeleteServersTestJSON-2061486758-project Sep 20 22:24:58.077697 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:24:58.077697 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:24:58.077697 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: e9f19d4f5e6243bab3819c7e609f534c Sep 20 22:24:58.077697 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-DeleteServersTestJSON-2061486758-project Sep 20 22:24:58.077697 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:24:58.077697 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:58.077697 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': '84071376-3176-4365-9249-7554ed26b308'} Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:24:58.078365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:24:58.079482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:24:58.079482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:24:58.079482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:24:58.079482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:24:58.079482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:24:58.079482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:24:58.079482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:24:58.079482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:58.079482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:58.079482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:24:58.079482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:58.079482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:24:58.079482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:24:58.079482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:24:58.079482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:24:58.079482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:24:58.079482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:58.079482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:58.080478 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-21097866-4fb9-4441-b475-d2ae56d32723 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Returning 404 to user: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:24:58.080478 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-21097866-4fb9-4441-b475-d2ae56d32723 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 404 len: 111 microversion: 2.1 time: 0.053657 Sep 20 22:24:58.080478 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 89/173] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:58 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:24:58.201531 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8e63d9fd-adc2-4909-9a57-0b6b93e4ce4a tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:58.201531 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8e63d9fd-adc2-4909-9a57-0b6b93e4ce4a tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] [instance: 073337e5-2eca-4195-a350-435ee3ff2fe7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:58.206050 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8e63d9fd-adc2-4909-9a57-0b6b93e4ce4a tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:58.206549 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8e63d9fd-adc2-4909-9a57-0b6b93e4ce4a tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:58.207180 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8e63d9fd-adc2-4909-9a57-0b6b93e4ce4a tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:58.207888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8e63d9fd-adc2-4909-9a57-0b6b93e4ce4a tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:58.208349 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8e63d9fd-adc2-4909-9a57-0b6b93e4ce4a tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:58.208771 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8e63d9fd-adc2-4909-9a57-0b6b93e4ce4a tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:58.210698 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-7cfad2c9-70dc-40a7-8eae-3d320b6ec134 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:58.213582 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-7cfad2c9-70dc-40a7-8eae-3d320b6ec134 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:58.224359 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7cfad2c9-70dc-40a7-8eae-3d320b6ec134 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:58.224859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7cfad2c9-70dc-40a7-8eae-3d320b6ec134 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:58.227232 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7cfad2c9-70dc-40a7-8eae-3d320b6ec134 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:58.227953 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7cfad2c9-70dc-40a7-8eae-3d320b6ec134 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:58.233315 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7cfad2c9-70dc-40a7-8eae-3d320b6ec134 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:58.233657 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7cfad2c9-70dc-40a7-8eae-3d320b6ec134 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:58.248422 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-7cfad2c9-70dc-40a7-8eae-3d320b6ec134 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] HTTP exception thrown: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-7cfad2c9-70dc-40a7-8eae-3d320b6ec134 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Request method failure captured: Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308/os-volume_attachments HTTP/1.1 Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj16djqYGzg6jdvbRT9Qqbut5WIgEKbS4fs5BVT6z9rLsJ-Q2HFHAL6B8vmzZA8deHN5ZLDNUGZpfokusIMxZAHpEW25K_byB1oab1_v-F0TeaUVY8sZnAlYvxXtc9EmQ1uTbXS5yAoj4_LRQCXqoMBrdn75f3fd1By8kBIPRqhDmuY Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 022e19ae817e4fb9b0eda463455c2ccf Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-DeleteServersTestJSON-2061486758 Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:24:58.250334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:24:58.251480 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/022e19ae817e4fb9b0eda463455c2ccf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_022e19ae817e4fb9b0eda463455c2ccf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/022e19ae817e4fb9b0eda463455c2ccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/022e19ae817e4fb9b0eda463455c2ccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:24:58.251480 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-DeleteServersTestJSON-2061486758 Sep 20 22:24:58.251480 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 022e19ae817e4fb9b0eda463455c2ccf Sep 20 22:24:58.251480 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-DeleteServersTestJSON-2061486758 Sep 20 22:24:58.251480 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-DeleteServersTestJSON-2061486758-project Sep 20 22:24:58.251480 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:24:58.251480 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:24:58.251480 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: e9f19d4f5e6243bab3819c7e609f534c Sep 20 22:24:58.251480 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-DeleteServersTestJSON-2061486758-project Sep 20 22:24:58.251480 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:24:58.251480 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:58.251480 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'server_id': '84071376-3176-4365-9249-7554ed26b308'} Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:24:58.252115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:58.253224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:58.254292 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-7cfad2c9-70dc-40a7-8eae-3d320b6ec134 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Returning 404 to user: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:24:58.254292 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-7cfad2c9-70dc-40a7-8eae-3d320b6ec134 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.045318 Sep 20 22:24:58.254292 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 90/174] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:24:58 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 22:24:58.295293 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-8e63d9fd-adc2-4909-9a57-0b6b93e4ce4a tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0900b908cdb94ccb9c577d814d852fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f356aca02448f8dbbf8c1d190259f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:58.305003 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-8e63d9fd-adc2-4909-9a57-0b6b93e4ce4a tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] 10.222.0.16 "GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7" status: 200 len: 1267 microversion: 2.1 time: 0.109495 Sep 20 22:24:58.310608 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 85/175] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:58 2022] GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7 => generated 1267 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:58.356987 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-20685e0b-376c-4697-8aeb-1be65ded4ef2 req-8e5c6fe6-53fe-412c-b814-c8d9147dd035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "269415dc-d013-4c2b-b7a5-7484844e870e", "tag": "d0e55512-d319-44ae-bea2-34196f7f6033"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:24:58.375225 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-20685e0b-376c-4697-8aeb-1be65ded4ef2 req-8e5c6fe6-53fe-412c-b814-c8d9147dd035 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:58.375704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-20685e0b-376c-4697-8aeb-1be65ded4ef2 req-8e5c6fe6-53fe-412c-b814-c8d9147dd035 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:58.376130 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-20685e0b-376c-4697-8aeb-1be65ded4ef2 req-8e5c6fe6-53fe-412c-b814-c8d9147dd035 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:58.392066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-20685e0b-376c-4697-8aeb-1be65ded4ef2 req-8e5c6fe6-53fe-412c-b814-c8d9147dd035 service nova] Creating event network-changed:d0e55512-d319-44ae-bea2-34196f7f6033 for instance 269415dc-d013-4c2b-b7a5-7484844e870e on hv-cinder-85827 Sep 20 22:24:58.396918 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-20685e0b-376c-4697-8aeb-1be65ded4ef2 req-8e5c6fe6-53fe-412c-b814-c8d9147dd035 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044219 Sep 20 22:24:58.397595 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 91/176] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:24:58.905907 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-1542d990-0192-4a02-ac38-f3af1cd38b19 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:58.906521 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-1542d990-0192-4a02-ac38-f3af1cd38b19 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:58.918331 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1542d990-0192-4a02-ac38-f3af1cd38b19 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:58.918827 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1542d990-0192-4a02-ac38-f3af1cd38b19 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:58.919437 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1542d990-0192-4a02-ac38-f3af1cd38b19 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:58.920150 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1542d990-0192-4a02-ac38-f3af1cd38b19 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:58.920610 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1542d990-0192-4a02-ac38-f3af1cd38b19 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:58.921063 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1542d990-0192-4a02-ac38-f3af1cd38b19 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:59.002590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-e1944967-0324-4e33-99b1-3b7b3990916f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:59.003860 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-e1944967-0324-4e33-99b1-3b7b3990916f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:59.010951 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e1944967-0324-4e33-99b1-3b7b3990916f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:59.011584 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e1944967-0324-4e33-99b1-3b7b3990916f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:59.012012 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e1944967-0324-4e33-99b1-3b7b3990916f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:59.012818 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e1944967-0324-4e33-99b1-3b7b3990916f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:59.013296 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e1944967-0324-4e33-99b1-3b7b3990916f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:59.013713 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e1944967-0324-4e33-99b1-3b7b3990916f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:59.079359 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-1542d990-0192-4a02-ac38-f3af1cd38b19 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:59.091324 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-1542d990-0192-4a02-ac38-f3af1cd38b19 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e" status: 200 len: 1314 microversion: 2.1 time: 0.189495 Sep 20 22:24:59.093473 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 86/177] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:58 2022] GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:24:59.198419 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-e1944967-0324-4e33-99b1-3b7b3990916f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:59.208947 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-e1944967-0324-4e33-99b1-3b7b3990916f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.211479 Sep 20 22:24:59.214698 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 92/178] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:58 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:24:59.334091 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-54d6b570-6056-4c69-a338-7ccdff2905ac tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:59.335012 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-54d6b570-6056-4c69-a338-7ccdff2905ac tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] [instance: 073337e5-2eca-4195-a350-435ee3ff2fe7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:59.342345 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54d6b570-6056-4c69-a338-7ccdff2905ac tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:59.342916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54d6b570-6056-4c69-a338-7ccdff2905ac tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:59.343412 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54d6b570-6056-4c69-a338-7ccdff2905ac tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:59.344195 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54d6b570-6056-4c69-a338-7ccdff2905ac tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:59.344708 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54d6b570-6056-4c69-a338-7ccdff2905ac tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:59.345314 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54d6b570-6056-4c69-a338-7ccdff2905ac tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:59.491307 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b662f905-c6bd-4a34-abe5-7606f560148b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:59.492142 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b662f905-c6bd-4a34-abe5-7606f560148b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:59.499450 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b662f905-c6bd-4a34-abe5-7606f560148b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:59.499953 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b662f905-c6bd-4a34-abe5-7606f560148b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:59.500603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b662f905-c6bd-4a34-abe5-7606f560148b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:59.501569 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b662f905-c6bd-4a34-abe5-7606f560148b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:59.502212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b662f905-c6bd-4a34-abe5-7606f560148b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:59.502818 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b662f905-c6bd-4a34-abe5-7606f560148b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:59.517880 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-b662f905-c6bd-4a34-abe5-7606f560148b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] HTTP exception thrown: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b662f905-c6bd-4a34-abe5-7606f560148b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Request method failure captured: Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: DELETE /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 HTTP/1.1 Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj16djqYGzg6jdvbRT9Qqbut5WIgEKbS4fs5BVT6z9rLsJ-Q2HFHAL6B8vmzZA8deHN5ZLDNUGZpfokusIMxZAHpEW25K_byB1oab1_v-F0TeaUVY8sZnAlYvxXtc9EmQ1uTbXS5yAoj4_LRQCXqoMBrdn75f3fd1By8kBIPRqhDmuY Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 022e19ae817e4fb9b0eda463455c2ccf Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-DeleteServersTestJSON-2061486758 Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:24:59.519554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:24:59.520994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/022e19ae817e4fb9b0eda463455c2ccf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_022e19ae817e4fb9b0eda463455c2ccf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/022e19ae817e4fb9b0eda463455c2ccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/022e19ae817e4fb9b0eda463455c2ccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:24:59.520994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-DeleteServersTestJSON-2061486758 Sep 20 22:24:59.520994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 022e19ae817e4fb9b0eda463455c2ccf Sep 20 22:24:59.520994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-DeleteServersTestJSON-2061486758 Sep 20 22:24:59.520994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-DeleteServersTestJSON-2061486758-project Sep 20 22:24:59.520994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:24:59.520994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:24:59.520994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: e9f19d4f5e6243bab3819c7e609f534c Sep 20 22:24:59.520994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-DeleteServersTestJSON-2061486758-project Sep 20 22:24:59.520994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:24:59.520994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:59.520994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': '84071376-3176-4365-9249-7554ed26b308'} Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:24:59.521800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:59.523205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:59.525851 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b662f905-c6bd-4a34-abe5-7606f560148b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Returning 404 to user: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:24:59.526728 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b662f905-c6bd-4a34-abe5-7606f560148b tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "DELETE /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 404 len: 111 microversion: 2.1 time: 0.039609 Sep 20 22:24:59.527298 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 93/179] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:24:59 2022] DELETE /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 22:24:59.535453 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-d1a2343c-8bd6-42fd-af6b-7104494fc368 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:24:59.536188 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-d1a2343c-8bd6-42fd-af6b-7104494fc368 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] [instance: 84071376-3176-4365-9249-7554ed26b308] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:24:59.542924 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d1a2343c-8bd6-42fd-af6b-7104494fc368 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:59.543569 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d1a2343c-8bd6-42fd-af6b-7104494fc368 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:59.544289 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d1a2343c-8bd6-42fd-af6b-7104494fc368 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:59.545312 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d1a2343c-8bd6-42fd-af6b-7104494fc368 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:24:59.545788 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d1a2343c-8bd6-42fd-af6b-7104494fc368 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:24:59.546547 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d1a2343c-8bd6-42fd-af6b-7104494fc368 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:24:59.564412 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-d1a2343c-8bd6-42fd-af6b-7104494fc368 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] HTTP exception thrown: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-d1a2343c-8bd6-42fd-af6b-7104494fc368 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Request method failure captured: Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 HTTP/1.1 Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj16djqYGzg6jdvbRT9Qqbut5WIgEKbS4fs5BVT6z9rLsJ-Q2HFHAL6B8vmzZA8deHN5ZLDNUGZpfokusIMxZAHpEW25K_byB1oab1_v-F0TeaUVY8sZnAlYvxXtc9EmQ1uTbXS5yAoj4_LRQCXqoMBrdn75f3fd1By8kBIPRqhDmuY Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 022e19ae817e4fb9b0eda463455c2ccf Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-DeleteServersTestJSON-2061486758 Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:24:59.565978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:24:59.567180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/022e19ae817e4fb9b0eda463455c2ccf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_022e19ae817e4fb9b0eda463455c2ccf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/022e19ae817e4fb9b0eda463455c2ccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/022e19ae817e4fb9b0eda463455c2ccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:24:59.567180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-DeleteServersTestJSON-2061486758 Sep 20 22:24:59.567180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 022e19ae817e4fb9b0eda463455c2ccf Sep 20 22:24:59.567180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-DeleteServersTestJSON-2061486758 Sep 20 22:24:59.567180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-DeleteServersTestJSON-2061486758-project Sep 20 22:24:59.567180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:24:59.567180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:24:59.567180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: e9f19d4f5e6243bab3819c7e609f534c Sep 20 22:24:59.567180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-DeleteServersTestJSON-2061486758-project Sep 20 22:24:59.567180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:24:59.567180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:59.567180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': '84071376-3176-4365-9249-7554ed26b308'} Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:24:59.567836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:24:59.568867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:24:59.568867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:24:59.568867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:24:59.568867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:24:59.568867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:24:59.568867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:24:59.568867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:24:59.568867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:59.568867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:59.568867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:24:59.568867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:59.568867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:24:59.568867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:24:59.568867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:24:59.568867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:24:59.568867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:24:59.568867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. Sep 20 22:24:59.568867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:24:59.569834 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-d1a2343c-8bd6-42fd-af6b-7104494fc368 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] Returning 404 to user: Instance 84071376-3176-4365-9249-7554ed26b308 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:24:59.569834 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-d1a2343c-8bd6-42fd-af6b-7104494fc368 tempest-DeleteServersTestJSON-2061486758 tempest-DeleteServersTestJSON-2061486758-project] 10.222.0.16 "GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308" status: 404 len: 111 microversion: 2.1 time: 0.035793 Sep 20 22:24:59.569834 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 94/180] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:59 2022] GET /compute/v2.1/servers/84071376-3176-4365-9249-7554ed26b308 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 22:24:59.663926 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-54d6b570-6056-4c69-a338-7ccdff2905ac tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0900b908cdb94ccb9c577d814d852fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f356aca02448f8dbbf8c1d190259f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:24:59.672031 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-54d6b570-6056-4c69-a338-7ccdff2905ac tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] 10.222.0.16 "GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7" status: 200 len: 1273 microversion: 2.1 time: 0.342014 Sep 20 22:24:59.672838 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 87/181] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:24:59 2022] GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7 => generated 1273 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:00.116720 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a1370937-0ffb-4bba-aefc-84379a469bbd tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:00.117913 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a1370937-0ffb-4bba-aefc-84379a469bbd tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:00.124748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a1370937-0ffb-4bba-aefc-84379a469bbd tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:00.125265 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a1370937-0ffb-4bba-aefc-84379a469bbd tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:00.125701 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a1370937-0ffb-4bba-aefc-84379a469bbd tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:00.126395 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a1370937-0ffb-4bba-aefc-84379a469bbd tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:00.126873 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a1370937-0ffb-4bba-aefc-84379a469bbd tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:00.127461 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a1370937-0ffb-4bba-aefc-84379a469bbd tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:00.240909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a9be1dc7-4e21-45ee-b8c0-31d2e30271b8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:00.241782 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a9be1dc7-4e21-45ee-b8c0-31d2e30271b8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:00.249790 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a9be1dc7-4e21-45ee-b8c0-31d2e30271b8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:00.250285 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a9be1dc7-4e21-45ee-b8c0-31d2e30271b8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:00.250722 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a9be1dc7-4e21-45ee-b8c0-31d2e30271b8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:00.251513 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a9be1dc7-4e21-45ee-b8c0-31d2e30271b8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:00.251865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a9be1dc7-4e21-45ee-b8c0-31d2e30271b8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:00.252287 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a9be1dc7-4e21-45ee-b8c0-31d2e30271b8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:00.357250 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a1370937-0ffb-4bba-aefc-84379a469bbd tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:00.367851 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a1370937-0ffb-4bba-aefc-84379a469bbd tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e" status: 200 len: 1314 microversion: 2.1 time: 0.255805 Sep 20 22:25:00.368761 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 95/182] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:00 2022] GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:00.410098 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a9be1dc7-4e21-45ee-b8c0-31d2e30271b8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:00.418031 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a9be1dc7-4e21-45ee-b8c0-31d2e30271b8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.182089 Sep 20 22:25:00.418609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 88/183] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:00 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:00.697104 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-99f84a5d-a983-4c71-9aed-6f731108e088 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:00.697819 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-99f84a5d-a983-4c71-9aed-6f731108e088 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] [instance: 073337e5-2eca-4195-a350-435ee3ff2fe7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:00.703725 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-99f84a5d-a983-4c71-9aed-6f731108e088 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:00.704284 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-99f84a5d-a983-4c71-9aed-6f731108e088 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:00.704790 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-99f84a5d-a983-4c71-9aed-6f731108e088 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:00.705591 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-99f84a5d-a983-4c71-9aed-6f731108e088 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:00.706226 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-99f84a5d-a983-4c71-9aed-6f731108e088 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:00.706693 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-99f84a5d-a983-4c71-9aed-6f731108e088 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:00.952610 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-99f84a5d-a983-4c71-9aed-6f731108e088 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0900b908cdb94ccb9c577d814d852fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f356aca02448f8dbbf8c1d190259f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:00.975521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-99f84a5d-a983-4c71-9aed-6f731108e088 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] 10.222.0.16 "GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7" status: 200 len: 1315 microversion: 2.1 time: 0.282113 Sep 20 22:25:00.976338 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 96/184] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:00 2022] GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:01.391664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-47f467d2-644d-4ffe-8cb9-0d2435bc74d7 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:01.392286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-47f467d2-644d-4ffe-8cb9-0d2435bc74d7 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:01.399881 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-47f467d2-644d-4ffe-8cb9-0d2435bc74d7 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:01.400912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-47f467d2-644d-4ffe-8cb9-0d2435bc74d7 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:01.401378 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-47f467d2-644d-4ffe-8cb9-0d2435bc74d7 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:01.402227 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-47f467d2-644d-4ffe-8cb9-0d2435bc74d7 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:01.402687 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-47f467d2-644d-4ffe-8cb9-0d2435bc74d7 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:01.403110 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-47f467d2-644d-4ffe-8cb9-0d2435bc74d7 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:01.442041 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-57ac4ccc-bc58-4c33-aab7-4da2e9e02c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:01.443317 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-57ac4ccc-bc58-4c33-aab7-4da2e9e02c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:01.452002 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-57ac4ccc-bc58-4c33-aab7-4da2e9e02c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:01.452713 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-57ac4ccc-bc58-4c33-aab7-4da2e9e02c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:01.453175 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-57ac4ccc-bc58-4c33-aab7-4da2e9e02c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:01.454031 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-57ac4ccc-bc58-4c33-aab7-4da2e9e02c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:01.454632 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-57ac4ccc-bc58-4c33-aab7-4da2e9e02c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:01.455204 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-57ac4ccc-bc58-4c33-aab7-4da2e9e02c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:01.610682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-47f467d2-644d-4ffe-8cb9-0d2435bc74d7 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:01.642205 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-47f467d2-644d-4ffe-8cb9-0d2435bc74d7 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e" status: 200 len: 1314 microversion: 2.1 time: 0.254460 Sep 20 22:25:01.644220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 89/185] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:01 2022] GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:01.664853 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-7a0bd64e-b444-4275-8d4f-0c14f18506bd req-3fd3eced-25ae-4469-8cb0-e8b8b23abf63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "073337e5-2eca-4195-a350-435ee3ff2fe7", "tag": "129be773-664e-42a2-b7d9-454685340602"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:25:01.702032 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-57ac4ccc-bc58-4c33-aab7-4da2e9e02c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:01.747118 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-57ac4ccc-bc58-4c33-aab7-4da2e9e02c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.304492 Sep 20 22:25:01.761324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 97/186] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:01 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:01.761722 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-7a0bd64e-b444-4275-8d4f-0c14f18506bd req-3fd3eced-25ae-4469-8cb0-e8b8b23abf63 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:01.761722 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-7a0bd64e-b444-4275-8d4f-0c14f18506bd req-3fd3eced-25ae-4469-8cb0-e8b8b23abf63 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:01.761722 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-7a0bd64e-b444-4275-8d4f-0c14f18506bd req-3fd3eced-25ae-4469-8cb0-e8b8b23abf63 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:01.797380 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-7a0bd64e-b444-4275-8d4f-0c14f18506bd req-3fd3eced-25ae-4469-8cb0-e8b8b23abf63 service nova] Creating event network-changed:129be773-664e-42a2-b7d9-454685340602 for instance 073337e5-2eca-4195-a350-435ee3ff2fe7 on hv-cinder-85827 Sep 20 22:25:01.814496 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-7a0bd64e-b444-4275-8d4f-0c14f18506bd req-3fd3eced-25ae-4469-8cb0-e8b8b23abf63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160112 Sep 20 22:25:01.818607 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 90/187] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:25:01.999194 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-e5d581d3-a33c-4a15-a356-cebda4ffaab1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:02.000024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-e5d581d3-a33c-4a15-a356-cebda4ffaab1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] [instance: 073337e5-2eca-4195-a350-435ee3ff2fe7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:02.011594 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e5d581d3-a33c-4a15-a356-cebda4ffaab1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:02.014126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e5d581d3-a33c-4a15-a356-cebda4ffaab1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:02.016380 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e5d581d3-a33c-4a15-a356-cebda4ffaab1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:02.019541 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e5d581d3-a33c-4a15-a356-cebda4ffaab1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:02.020223 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e5d581d3-a33c-4a15-a356-cebda4ffaab1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:02.022645 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e5d581d3-a33c-4a15-a356-cebda4ffaab1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:02.456651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-e5d581d3-a33c-4a15-a356-cebda4ffaab1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0900b908cdb94ccb9c577d814d852fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f356aca02448f8dbbf8c1d190259f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:02.469788 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-e5d581d3-a33c-4a15-a356-cebda4ffaab1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] 10.222.0.16 "GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7" status: 200 len: 1315 microversion: 2.1 time: 0.474656 Sep 20 22:25:02.470409 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 98/188] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:01 2022] GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:02.670424 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-62c4a71b-b6f7-4d99-8339-0ba9577dcf33 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:02.671905 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-62c4a71b-b6f7-4d99-8339-0ba9577dcf33 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:02.678987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-62c4a71b-b6f7-4d99-8339-0ba9577dcf33 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:02.679523 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-62c4a71b-b6f7-4d99-8339-0ba9577dcf33 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:02.679961 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-62c4a71b-b6f7-4d99-8339-0ba9577dcf33 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:02.680702 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-62c4a71b-b6f7-4d99-8339-0ba9577dcf33 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:02.681419 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-62c4a71b-b6f7-4d99-8339-0ba9577dcf33 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:02.681847 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-62c4a71b-b6f7-4d99-8339-0ba9577dcf33 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:02.773315 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-479cea88-3370-413d-b650-146bce11ab51 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:02.783418 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-479cea88-3370-413d-b650-146bce11ab51 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:02.795733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-479cea88-3370-413d-b650-146bce11ab51 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:02.796845 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-479cea88-3370-413d-b650-146bce11ab51 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:02.798075 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-479cea88-3370-413d-b650-146bce11ab51 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:02.799190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-479cea88-3370-413d-b650-146bce11ab51 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:02.800861 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-479cea88-3370-413d-b650-146bce11ab51 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:02.801544 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-479cea88-3370-413d-b650-146bce11ab51 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:02.921098 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-62c4a71b-b6f7-4d99-8339-0ba9577dcf33 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:02.929029 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-62c4a71b-b6f7-4d99-8339-0ba9577dcf33 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e" status: 200 len: 1314 microversion: 2.1 time: 0.264461 Sep 20 22:25:02.946301 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 91/189] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:02 2022] GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:03.042119 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-479cea88-3370-413d-b650-146bce11ab51 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:03.050561 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-479cea88-3370-413d-b650-146bce11ab51 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.281483 Sep 20 22:25:03.051344 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 99/190] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:02 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:03.493225 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-5e797b37-4602-4c77-9d1c-e579565aa800 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:03.494457 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-5e797b37-4602-4c77-9d1c-e579565aa800 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] [instance: 073337e5-2eca-4195-a350-435ee3ff2fe7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:03.501047 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5e797b37-4602-4c77-9d1c-e579565aa800 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:03.501741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5e797b37-4602-4c77-9d1c-e579565aa800 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:03.502232 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5e797b37-4602-4c77-9d1c-e579565aa800 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:03.502930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5e797b37-4602-4c77-9d1c-e579565aa800 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:03.503522 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5e797b37-4602-4c77-9d1c-e579565aa800 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:03.504315 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5e797b37-4602-4c77-9d1c-e579565aa800 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:03.954146 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-54ba85e2-a067-4a71-b98e-dcc4227eb18c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:03.954958 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-54ba85e2-a067-4a71-b98e-dcc4227eb18c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:03.968515 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-5e797b37-4602-4c77-9d1c-e579565aa800 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0900b908cdb94ccb9c577d814d852fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f356aca02448f8dbbf8c1d190259f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:03.970692 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-54ba85e2-a067-4a71-b98e-dcc4227eb18c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:03.972704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-54ba85e2-a067-4a71-b98e-dcc4227eb18c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:03.974469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-54ba85e2-a067-4a71-b98e-dcc4227eb18c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:03.976945 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-54ba85e2-a067-4a71-b98e-dcc4227eb18c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:03.977614 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-54ba85e2-a067-4a71-b98e-dcc4227eb18c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:03.979908 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-54ba85e2-a067-4a71-b98e-dcc4227eb18c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:03.980227 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-5e797b37-4602-4c77-9d1c-e579565aa800 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] 10.222.0.16 "GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7" status: 200 len: 1315 microversion: 2.1 time: 0.491133 Sep 20 22:25:03.980832 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 92/191] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:03 2022] GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7 => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:04.077328 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-440bdd84-20a1-4655-9947-7fca5ac9ea98 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:04.077947 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-440bdd84-20a1-4655-9947-7fca5ac9ea98 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:04.089740 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=80 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:04.094310 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-440bdd84-20a1-4655-9947-7fca5ac9ea98 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:04.095617 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-440bdd84-20a1-4655-9947-7fca5ac9ea98 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:04.096064 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-440bdd84-20a1-4655-9947-7fca5ac9ea98 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:04.096781 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-440bdd84-20a1-4655-9947-7fca5ac9ea98 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:04.097282 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-440bdd84-20a1-4655-9947-7fca5ac9ea98 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:04.097707 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-440bdd84-20a1-4655-9947-7fca5ac9ea98 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:04.130992 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=100 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:04.251199 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-54ba85e2-a067-4a71-b98e-dcc4227eb18c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:04.260415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-54ba85e2-a067-4a71-b98e-dcc4227eb18c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e" status: 200 len: 1314 microversion: 2.1 time: 0.310680 Sep 20 22:25:04.262008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 100/192] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:03 2022] GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:04.529225 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-747a4882-5546-4d07-901a-8fd9298a3292 req-67f885c9-43bc-4871-8657-688adf4066a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269415dc-d013-4c2b-b7a5-7484844e870e", "name": "network-vif-plugged", "status": "completed", "tag": "d0e55512-d319-44ae-bea2-34196f7f6033"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:25:04.543485 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-747a4882-5546-4d07-901a-8fd9298a3292 req-67f885c9-43bc-4871-8657-688adf4066a3 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:04.544351 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-747a4882-5546-4d07-901a-8fd9298a3292 req-67f885c9-43bc-4871-8657-688adf4066a3 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:04.545049 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-747a4882-5546-4d07-901a-8fd9298a3292 req-67f885c9-43bc-4871-8657-688adf4066a3 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:04.560272 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-747a4882-5546-4d07-901a-8fd9298a3292 req-67f885c9-43bc-4871-8657-688adf4066a3 service nova] Creating event network-vif-plugged:d0e55512-d319-44ae-bea2-34196f7f6033 for instance 269415dc-d013-4c2b-b7a5-7484844e870e on hv-cinder-85827 Sep 20 22:25:04.560446 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-440bdd84-20a1-4655-9947-7fca5ac9ea98 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:04.569244 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-747a4882-5546-4d07-901a-8fd9298a3292 req-67f885c9-43bc-4871-8657-688adf4066a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041806 Sep 20 22:25:04.570705 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 101/193] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:25:04.574352 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-440bdd84-20a1-4655-9947-7fca5ac9ea98 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.505662 Sep 20 22:25:04.575923 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 93/194] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:04 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:05.017363 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-d014a776-0f1f-401e-9595-d53c59683869 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:05.020851 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-d014a776-0f1f-401e-9595-d53c59683869 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] [instance: 073337e5-2eca-4195-a350-435ee3ff2fe7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:05.031953 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d014a776-0f1f-401e-9595-d53c59683869 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:05.032609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d014a776-0f1f-401e-9595-d53c59683869 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:05.033415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d014a776-0f1f-401e-9595-d53c59683869 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:05.034693 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d014a776-0f1f-401e-9595-d53c59683869 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:05.035997 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d014a776-0f1f-401e-9595-d53c59683869 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:05.036592 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d014a776-0f1f-401e-9595-d53c59683869 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:05.283648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8c18bb42-ebc5-4d4a-85e4-0ab050453b3b tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:05.285278 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8c18bb42-ebc5-4d4a-85e4-0ab050453b3b tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:05.292652 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8c18bb42-ebc5-4d4a-85e4-0ab050453b3b tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:05.293490 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8c18bb42-ebc5-4d4a-85e4-0ab050453b3b tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:05.294136 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8c18bb42-ebc5-4d4a-85e4-0ab050453b3b tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:05.295140 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8c18bb42-ebc5-4d4a-85e4-0ab050453b3b tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:05.295799 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8c18bb42-ebc5-4d4a-85e4-0ab050453b3b tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:05.296391 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8c18bb42-ebc5-4d4a-85e4-0ab050453b3b tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:05.341992 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-d014a776-0f1f-401e-9595-d53c59683869 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0900b908cdb94ccb9c577d814d852fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f356aca02448f8dbbf8c1d190259f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:05.352403 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-d014a776-0f1f-401e-9595-d53c59683869 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] 10.222.0.16 "GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7" status: 200 len: 1315 microversion: 2.1 time: 0.349939 Sep 20 22:25:05.353261 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 102/195] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:05 2022] GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:05.508854 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-8c18bb42-ebc5-4d4a-85e4-0ab050453b3b tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:05.520169 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-8c18bb42-ebc5-4d4a-85e4-0ab050453b3b tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e" status: 200 len: 1314 microversion: 2.1 time: 0.240299 Sep 20 22:25:05.520763 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 94/196] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:05 2022] GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:05.603914 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f2be9fef-7249-4925-8b55-d5df7ec0d173 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:05.604758 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-f2be9fef-7249-4925-8b55-d5df7ec0d173 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:05.611166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f2be9fef-7249-4925-8b55-d5df7ec0d173 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:05.611821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f2be9fef-7249-4925-8b55-d5df7ec0d173 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:05.612409 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f2be9fef-7249-4925-8b55-d5df7ec0d173 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:05.613470 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f2be9fef-7249-4925-8b55-d5df7ec0d173 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:05.614061 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f2be9fef-7249-4925-8b55-d5df7ec0d173 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:05.614651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f2be9fef-7249-4925-8b55-d5df7ec0d173 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:05.759727 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-f2be9fef-7249-4925-8b55-d5df7ec0d173 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:05.778715 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-f2be9fef-7249-4925-8b55-d5df7ec0d173 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.180499 Sep 20 22:25:05.779751 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 103/197] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:05 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:06.380121 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-65e0a8dc-dd01-4ef0-ac68-0540d872460d tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:06.381440 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-65e0a8dc-dd01-4ef0-ac68-0540d872460d tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] [instance: 073337e5-2eca-4195-a350-435ee3ff2fe7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:06.387689 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-65e0a8dc-dd01-4ef0-ac68-0540d872460d tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:06.389057 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-65e0a8dc-dd01-4ef0-ac68-0540d872460d tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:06.389961 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-65e0a8dc-dd01-4ef0-ac68-0540d872460d tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:06.391813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-65e0a8dc-dd01-4ef0-ac68-0540d872460d tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:06.392531 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-65e0a8dc-dd01-4ef0-ac68-0540d872460d tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:06.393149 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-65e0a8dc-dd01-4ef0-ac68-0540d872460d tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:06.544114 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-47884a03-e238-43ae-bfd7-68081d066f05 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:06.544816 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-47884a03-e238-43ae-bfd7-68081d066f05 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:06.551669 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-47884a03-e238-43ae-bfd7-68081d066f05 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:06.554799 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-65e0a8dc-dd01-4ef0-ac68-0540d872460d tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0900b908cdb94ccb9c577d814d852fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f356aca02448f8dbbf8c1d190259f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:06.564218 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-47884a03-e238-43ae-bfd7-68081d066f05 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:06.564685 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-47884a03-e238-43ae-bfd7-68081d066f05 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:06.565527 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-47884a03-e238-43ae-bfd7-68081d066f05 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:06.565985 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-47884a03-e238-43ae-bfd7-68081d066f05 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:06.567166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-47884a03-e238-43ae-bfd7-68081d066f05 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:06.568542 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-65e0a8dc-dd01-4ef0-ac68-0540d872460d tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] 10.222.0.16 "GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7" status: 200 len: 1315 microversion: 2.1 time: 0.188210 Sep 20 22:25:06.569173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 95/198] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:06 2022] GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:06.587801 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:06.613591 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-a2d0c561-7e60-4dee-adf5-bd5114c98a1e req-dfb430d1-170a-4966-a9bd-ab756a295402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "073337e5-2eca-4195-a350-435ee3ff2fe7", "name": "network-vif-plugged", "status": "completed", "tag": "129be773-664e-42a2-b7d9-454685340602"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:25:06.626981 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-a2d0c561-7e60-4dee-adf5-bd5114c98a1e req-dfb430d1-170a-4966-a9bd-ab756a295402 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:06.627460 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-a2d0c561-7e60-4dee-adf5-bd5114c98a1e req-dfb430d1-170a-4966-a9bd-ab756a295402 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:06.628043 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-a2d0c561-7e60-4dee-adf5-bd5114c98a1e req-dfb430d1-170a-4966-a9bd-ab756a295402 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:06.641119 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-a2d0c561-7e60-4dee-adf5-bd5114c98a1e req-dfb430d1-170a-4966-a9bd-ab756a295402 service nova] Creating event network-vif-plugged:129be773-664e-42a2-b7d9-454685340602 for instance 073337e5-2eca-4195-a350-435ee3ff2fe7 on hv-cinder-85827 Sep 20 22:25:06.646713 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-a2d0c561-7e60-4dee-adf5-bd5114c98a1e req-dfb430d1-170a-4966-a9bd-ab756a295402 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037172 Sep 20 22:25:06.647300 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 96/199] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:25:06.724081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-47884a03-e238-43ae-bfd7-68081d066f05 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:06.732201 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-47884a03-e238-43ae-bfd7-68081d066f05 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e" status: 200 len: 1498 microversion: 2.1 time: 0.192630 Sep 20 22:25:06.745241 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 104/200] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:06 2022] GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e => generated 1498 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:06.803177 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a674636a-2b39-486d-b458-03162d54fdeb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:06.803871 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a674636a-2b39-486d-b458-03162d54fdeb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:06.810897 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a674636a-2b39-486d-b458-03162d54fdeb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:06.811382 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a674636a-2b39-486d-b458-03162d54fdeb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:06.812028 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a674636a-2b39-486d-b458-03162d54fdeb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:06.812706 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a674636a-2b39-486d-b458-03162d54fdeb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:06.813186 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a674636a-2b39-486d-b458-03162d54fdeb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:06.813600 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a674636a-2b39-486d-b458-03162d54fdeb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:06.996789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a674636a-2b39-486d-b458-03162d54fdeb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:07.014526 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a674636a-2b39-486d-b458-03162d54fdeb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.214677 Sep 20 22:25:07.029637 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 97/201] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:06 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:07.418445 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-88b6558e-054f-4ae1-964a-83563764da1a tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:07.419175 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-88b6558e-054f-4ae1-964a-83563764da1a tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:07.421241 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=4 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:07.422285 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=14 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:07.428533 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-88b6558e-054f-4ae1-964a-83563764da1a tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:07.429044 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-88b6558e-054f-4ae1-964a-83563764da1a tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:07.429474 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-88b6558e-054f-4ae1-964a-83563764da1a tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:07.430169 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-88b6558e-054f-4ae1-964a-83563764da1a tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:07.430615 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-88b6558e-054f-4ae1-964a-83563764da1a tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:07.431030 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-88b6558e-054f-4ae1-964a-83563764da1a tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:07.456460 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-88b6558e-054f-4ae1-964a-83563764da1a tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Going to try to terminate instance {{(pid=120474) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:25:07.533519 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-88b6558e-054f-4ae1-964a-83563764da1a tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "DELETE /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e" status: 204 len: 0 microversion: 2.1 time: 0.119224 Sep 20 22:25:07.537604 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 105/202] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:25:07 2022] DELETE /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:25:07.544503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a4ee560f-e33e-4da9-a205-1b8976bb0656 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:07.545259 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a4ee560f-e33e-4da9-a205-1b8976bb0656 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:07.547276 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=2 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:07.552650 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a4ee560f-e33e-4da9-a205-1b8976bb0656 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:07.553266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a4ee560f-e33e-4da9-a205-1b8976bb0656 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:07.553696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a4ee560f-e33e-4da9-a205-1b8976bb0656 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:07.554381 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a4ee560f-e33e-4da9-a205-1b8976bb0656 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:07.554827 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a4ee560f-e33e-4da9-a205-1b8976bb0656 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:07.555241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a4ee560f-e33e-4da9-a205-1b8976bb0656 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:07.597418 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-81f64c66-0324-417e-9526-42dea20fe63c tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:07.598053 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-81f64c66-0324-417e-9526-42dea20fe63c tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] [instance: 073337e5-2eca-4195-a350-435ee3ff2fe7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:07.611721 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-81f64c66-0324-417e-9526-42dea20fe63c tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:07.612208 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-81f64c66-0324-417e-9526-42dea20fe63c tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:07.612638 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-81f64c66-0324-417e-9526-42dea20fe63c tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:07.613570 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-81f64c66-0324-417e-9526-42dea20fe63c tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:07.613844 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-81f64c66-0324-417e-9526-42dea20fe63c tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:07.615423 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-81f64c66-0324-417e-9526-42dea20fe63c tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:07.707276 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a4ee560f-e33e-4da9-a205-1b8976bb0656 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:07.716239 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a4ee560f-e33e-4da9-a205-1b8976bb0656 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e" status: 200 len: 1504 microversion: 2.1 time: 0.176842 Sep 20 22:25:07.717229 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 98/203] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:07 2022] GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:07.753557 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-81f64c66-0324-417e-9526-42dea20fe63c tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0900b908cdb94ccb9c577d814d852fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f356aca02448f8dbbf8c1d190259f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:07.761338 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-81f64c66-0324-417e-9526-42dea20fe63c tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] 10.222.0.16 "GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7" status: 200 len: 1315 microversion: 2.1 time: 0.170399 Sep 20 22:25:07.762084 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 106/204] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:07 2022] GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:08.046135 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-de9d8c80-37bb-4960-8994-840b4d61bba1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:08.047652 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-de9d8c80-37bb-4960-8994-840b4d61bba1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:08.064092 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-de9d8c80-37bb-4960-8994-840b4d61bba1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:08.065542 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-de9d8c80-37bb-4960-8994-840b4d61bba1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:08.067932 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-de9d8c80-37bb-4960-8994-840b4d61bba1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:08.068870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-de9d8c80-37bb-4960-8994-840b4d61bba1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:08.069484 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-de9d8c80-37bb-4960-8994-840b4d61bba1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:08.070799 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-de9d8c80-37bb-4960-8994-840b4d61bba1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:08.207289 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-de9d8c80-37bb-4960-8994-840b4d61bba1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:08.215367 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-de9d8c80-37bb-4960-8994-840b4d61bba1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.178574 Sep 20 22:25:08.216552 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 99/205] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:08 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:08.740539 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c1b1ee9e-079b-4481-8a83-4ebf64926ec6 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:08.742309 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-c1b1ee9e-079b-4481-8a83-4ebf64926ec6 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:08.745477 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:08.751605 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c1b1ee9e-079b-4481-8a83-4ebf64926ec6 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:08.752049 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c1b1ee9e-079b-4481-8a83-4ebf64926ec6 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:08.752478 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c1b1ee9e-079b-4481-8a83-4ebf64926ec6 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:08.753199 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c1b1ee9e-079b-4481-8a83-4ebf64926ec6 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:08.753649 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c1b1ee9e-079b-4481-8a83-4ebf64926ec6 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:08.754067 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c1b1ee9e-079b-4481-8a83-4ebf64926ec6 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:08.783575 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-41b19f4d-efe3-408b-8dcc-bc9bf386bea1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:08.784184 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-41b19f4d-efe3-408b-8dcc-bc9bf386bea1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] [instance: 073337e5-2eca-4195-a350-435ee3ff2fe7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:08.789980 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-41b19f4d-efe3-408b-8dcc-bc9bf386bea1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:08.790696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-41b19f4d-efe3-408b-8dcc-bc9bf386bea1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:08.791132 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-41b19f4d-efe3-408b-8dcc-bc9bf386bea1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:08.791810 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-41b19f4d-efe3-408b-8dcc-bc9bf386bea1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:08.792533 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-41b19f4d-efe3-408b-8dcc-bc9bf386bea1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:08.793133 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-41b19f4d-efe3-408b-8dcc-bc9bf386bea1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:08.909597 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-c1b1ee9e-079b-4481-8a83-4ebf64926ec6 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:08.917289 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c1b1ee9e-079b-4481-8a83-4ebf64926ec6 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e" status: 200 len: 1504 microversion: 2.1 time: 0.181204 Sep 20 22:25:08.917872 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 107/206] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:08 2022] GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:08.945753 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-41b19f4d-efe3-408b-8dcc-bc9bf386bea1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0900b908cdb94ccb9c577d814d852fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f356aca02448f8dbbf8c1d190259f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:08.953556 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-41b19f4d-efe3-408b-8dcc-bc9bf386bea1 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] 10.222.0.16 "GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7" status: 200 len: 1315 microversion: 2.1 time: 0.173730 Sep 20 22:25:08.954458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 100/207] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:08 2022] GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:09.238911 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-22710011-87f2-4de9-8dab-6d89c39c90ef tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:09.239527 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-22710011-87f2-4de9-8dab-6d89c39c90ef tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:09.245825 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-22710011-87f2-4de9-8dab-6d89c39c90ef tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:09.246566 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-22710011-87f2-4de9-8dab-6d89c39c90ef tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:09.247165 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-22710011-87f2-4de9-8dab-6d89c39c90ef tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:09.247866 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-22710011-87f2-4de9-8dab-6d89c39c90ef tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:09.248324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-22710011-87f2-4de9-8dab-6d89c39c90ef tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:09.248748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-22710011-87f2-4de9-8dab-6d89c39c90ef tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:09.385937 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-22710011-87f2-4de9-8dab-6d89c39c90ef tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:09.394069 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-22710011-87f2-4de9-8dab-6d89c39c90ef tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.159094 Sep 20 22:25:09.394635 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 108/208] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:09 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:09.940671 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-eaebdc0a-67d1-46aa-8cde-da10c7068d48 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:09.941320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-eaebdc0a-67d1-46aa-8cde-da10c7068d48 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:09.948196 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-eaebdc0a-67d1-46aa-8cde-da10c7068d48 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:09.949163 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-eaebdc0a-67d1-46aa-8cde-da10c7068d48 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:09.949607 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-eaebdc0a-67d1-46aa-8cde-da10c7068d48 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:09.950310 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-eaebdc0a-67d1-46aa-8cde-da10c7068d48 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:09.950775 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-eaebdc0a-67d1-46aa-8cde-da10c7068d48 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:09.951203 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-eaebdc0a-67d1-46aa-8cde-da10c7068d48 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:09.979335 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f17071ac-885f-4f21-a055-8287c58c3cf0 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:09.979976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-f17071ac-885f-4f21-a055-8287c58c3cf0 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] [instance: 073337e5-2eca-4195-a350-435ee3ff2fe7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:09.986436 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f17071ac-885f-4f21-a055-8287c58c3cf0 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:09.986916 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f17071ac-885f-4f21-a055-8287c58c3cf0 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:09.987376 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f17071ac-885f-4f21-a055-8287c58c3cf0 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:09.988387 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f17071ac-885f-4f21-a055-8287c58c3cf0 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:09.988842 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f17071ac-885f-4f21-a055-8287c58c3cf0 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:09.989440 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f17071ac-885f-4f21-a055-8287c58c3cf0 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:10.105694 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-eaebdc0a-67d1-46aa-8cde-da10c7068d48 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:10.113697 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-eaebdc0a-67d1-46aa-8cde-da10c7068d48 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e" status: 200 len: 1504 microversion: 2.1 time: 0.176816 Sep 20 22:25:10.114270 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 101/209] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:09 2022] GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:10.265942 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-f17071ac-885f-4f21-a055-8287c58c3cf0 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0900b908cdb94ccb9c577d814d852fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f356aca02448f8dbbf8c1d190259f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:10.273998 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-f17071ac-885f-4f21-a055-8287c58c3cf0 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] 10.222.0.16 "GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7" status: 200 len: 1464 microversion: 2.1 time: 0.299203 Sep 20 22:25:10.274763 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 109/210] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:09 2022] GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7 => generated 1464 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:10.326900 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-855c0ae2-8c22-4f3a-b67e-941315dd4070 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:10.328536 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-855c0ae2-8c22-4f3a-b67e-941315dd4070 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] [instance: 073337e5-2eca-4195-a350-435ee3ff2fe7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:10.338940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-855c0ae2-8c22-4f3a-b67e-941315dd4070 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:10.339845 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-855c0ae2-8c22-4f3a-b67e-941315dd4070 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:10.340346 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-855c0ae2-8c22-4f3a-b67e-941315dd4070 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:10.341489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-855c0ae2-8c22-4f3a-b67e-941315dd4070 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:10.342514 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-855c0ae2-8c22-4f3a-b67e-941315dd4070 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:10.343891 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-855c0ae2-8c22-4f3a-b67e-941315dd4070 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:10.386297 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-855c0ae2-8c22-4f3a-b67e-941315dd4070 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] [instance: 073337e5-2eca-4195-a350-435ee3ff2fe7] Going to try to terminate instance {{(pid=120473) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:25:10.417049 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-270870f1-811d-4c4a-a43a-01764e8e2225 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:10.417798 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-270870f1-811d-4c4a-a43a-01764e8e2225 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:10.428598 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-270870f1-811d-4c4a-a43a-01764e8e2225 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:10.429139 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-270870f1-811d-4c4a-a43a-01764e8e2225 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:10.434592 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-270870f1-811d-4c4a-a43a-01764e8e2225 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:10.435353 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-270870f1-811d-4c4a-a43a-01764e8e2225 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:10.435865 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-270870f1-811d-4c4a-a43a-01764e8e2225 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:10.436296 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-270870f1-811d-4c4a-a43a-01764e8e2225 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:10.510740 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-855c0ae2-8c22-4f3a-b67e-941315dd4070 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] 10.222.0.16 "DELETE /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7" status: 204 len: 0 microversion: 2.1 time: 0.190484 Sep 20 22:25:10.511336 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 102/211] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:25:10 2022] DELETE /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:25:10.521949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-a94c3c6e-ba23-4392-af67-0c804a7a2b7f req-25c5eba3-89b5-4806-b57d-de12969c19a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269415dc-d013-4c2b-b7a5-7484844e870e", "name": "network-vif-deleted", "tag": "d0e55512-d319-44ae-bea2-34196f7f6033"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:25:10.534447 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-a94c3c6e-ba23-4392-af67-0c804a7a2b7f req-25c5eba3-89b5-4806-b57d-de12969c19a5 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:10.534838 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-a94c3c6e-ba23-4392-af67-0c804a7a2b7f req-25c5eba3-89b5-4806-b57d-de12969c19a5 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:10.535257 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-a94c3c6e-ba23-4392-af67-0c804a7a2b7f req-25c5eba3-89b5-4806-b57d-de12969c19a5 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:10.551822 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-a94c3c6e-ba23-4392-af67-0c804a7a2b7f req-25c5eba3-89b5-4806-b57d-de12969c19a5 service nova] Creating event network-vif-deleted:d0e55512-d319-44ae-bea2-34196f7f6033 for instance 269415dc-d013-4c2b-b7a5-7484844e870e on hv-cinder-85827 Sep 20 22:25:10.557575 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-a94c3c6e-ba23-4392-af67-0c804a7a2b7f req-25c5eba3-89b5-4806-b57d-de12969c19a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041473 Sep 20 22:25:10.558516 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 103/212] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:25:10.563582 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-f4d55e89-39c3-4f0d-a6e3-ac8ceb5e5470 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:10.564167 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-f4d55e89-39c3-4f0d-a6e3-ac8ceb5e5470 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] [instance: 073337e5-2eca-4195-a350-435ee3ff2fe7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:10.570444 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f4d55e89-39c3-4f0d-a6e3-ac8ceb5e5470 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:10.570935 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f4d55e89-39c3-4f0d-a6e3-ac8ceb5e5470 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:10.571371 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f4d55e89-39c3-4f0d-a6e3-ac8ceb5e5470 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:10.572107 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f4d55e89-39c3-4f0d-a6e3-ac8ceb5e5470 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:10.572563 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f4d55e89-39c3-4f0d-a6e3-ac8ceb5e5470 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:10.573012 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f4d55e89-39c3-4f0d-a6e3-ac8ceb5e5470 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:10.610937 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-270870f1-811d-4c4a-a43a-01764e8e2225 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:10.619523 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-270870f1-811d-4c4a-a43a-01764e8e2225 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.206134 Sep 20 22:25:10.620110 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 110/213] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:10 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:10.713473 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f4d55e89-39c3-4f0d-a6e3-ac8ceb5e5470 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0900b908cdb94ccb9c577d814d852fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f356aca02448f8dbbf8c1d190259f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:10.722245 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-f4d55e89-39c3-4f0d-a6e3-ac8ceb5e5470 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] 10.222.0.16 "GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7" status: 200 len: 1470 microversion: 2.1 time: 0.162598 Sep 20 22:25:10.730534 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 104/214] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:10 2022] GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:11.140848 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-86ca4942-553d-426f-8498-561a2247dd2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:11.142070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-86ca4942-553d-426f-8498-561a2247dd2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:11.150770 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-86ca4942-553d-426f-8498-561a2247dd2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:11.151569 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-86ca4942-553d-426f-8498-561a2247dd2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:11.152135 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-86ca4942-553d-426f-8498-561a2247dd2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:11.153418 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-86ca4942-553d-426f-8498-561a2247dd2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:11.153942 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-86ca4942-553d-426f-8498-561a2247dd2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:11.154432 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-86ca4942-553d-426f-8498-561a2247dd2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:11.187445 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-86ca4942-553d-426f-8498-561a2247dd2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:11.188093 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-86ca4942-553d-426f-8498-561a2247dd2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:11.189801 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-86ca4942-553d-426f-8498-561a2247dd2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:11.190318 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-86ca4942-553d-426f-8498-561a2247dd2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lazy-loading 'fault' on Instance uuid 269415dc-d013-4c2b-b7a5-7484844e870e {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:25:11.250927 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-86ca4942-553d-426f-8498-561a2247dd2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:11.260305 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-86ca4942-553d-426f-8498-561a2247dd2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e" status: 200 len: 1304 microversion: 2.1 time: 0.124483 Sep 20 22:25:11.261002 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 111/215] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:11 2022] GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:11.642730 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d372d468-f9e4-44c3-b9db-e8c2d3dfe297 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:11.643908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d372d468-f9e4-44c3-b9db-e8c2d3dfe297 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:11.651840 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d372d468-f9e4-44c3-b9db-e8c2d3dfe297 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:11.652675 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d372d468-f9e4-44c3-b9db-e8c2d3dfe297 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:11.653358 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d372d468-f9e4-44c3-b9db-e8c2d3dfe297 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:11.654566 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d372d468-f9e4-44c3-b9db-e8c2d3dfe297 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:11.655060 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d372d468-f9e4-44c3-b9db-e8c2d3dfe297 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:11.655567 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d372d468-f9e4-44c3-b9db-e8c2d3dfe297 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:11.747044 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-11e2e321-fae5-4ff6-8b56-e9b4f182a924 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:11.747663 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-11e2e321-fae5-4ff6-8b56-e9b4f182a924 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] [instance: 073337e5-2eca-4195-a350-435ee3ff2fe7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:11.759354 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-11e2e321-fae5-4ff6-8b56-e9b4f182a924 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:11.759848 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-11e2e321-fae5-4ff6-8b56-e9b4f182a924 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:11.760345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-11e2e321-fae5-4ff6-8b56-e9b4f182a924 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:11.761076 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-11e2e321-fae5-4ff6-8b56-e9b4f182a924 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:11.762530 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-11e2e321-fae5-4ff6-8b56-e9b4f182a924 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:11.762960 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-11e2e321-fae5-4ff6-8b56-e9b4f182a924 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:11.861978 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-d372d468-f9e4-44c3-b9db-e8c2d3dfe297 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:11.872110 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-d372d468-f9e4-44c3-b9db-e8c2d3dfe297 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.233557 Sep 20 22:25:11.891077 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 105/216] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:11 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:11.991391 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-11e2e321-fae5-4ff6-8b56-e9b4f182a924 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0900b908cdb94ccb9c577d814d852fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f356aca02448f8dbbf8c1d190259f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:12.000892 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-11e2e321-fae5-4ff6-8b56-e9b4f182a924 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] 10.222.0.16 "GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7" status: 200 len: 1470 microversion: 2.1 time: 0.258874 Sep 20 22:25:12.001439 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 112/217] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:11 2022] GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7 => generated 1470 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:12.286446 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-584f52a7-c21f-4ef3-97f4-55e9c16c6d10 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:12.287278 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-584f52a7-c21f-4ef3-97f4-55e9c16c6d10 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:12.295054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-584f52a7-c21f-4ef3-97f4-55e9c16c6d10 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:12.295769 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-584f52a7-c21f-4ef3-97f4-55e9c16c6d10 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:12.298129 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-584f52a7-c21f-4ef3-97f4-55e9c16c6d10 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:12.299003 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-584f52a7-c21f-4ef3-97f4-55e9c16c6d10 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:12.299606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-584f52a7-c21f-4ef3-97f4-55e9c16c6d10 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:12.300171 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-584f52a7-c21f-4ef3-97f4-55e9c16c6d10 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:12.367583 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-584f52a7-c21f-4ef3-97f4-55e9c16c6d10 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:12.377616 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-584f52a7-c21f-4ef3-97f4-55e9c16c6d10 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:12.378072 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-584f52a7-c21f-4ef3-97f4-55e9c16c6d10 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:12.378543 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-584f52a7-c21f-4ef3-97f4-55e9c16c6d10 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lazy-loading 'fault' on Instance uuid 269415dc-d013-4c2b-b7a5-7484844e870e {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:25:12.446259 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-584f52a7-c21f-4ef3-97f4-55e9c16c6d10 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:12.454650 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-584f52a7-c21f-4ef3-97f4-55e9c16c6d10 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e" status: 200 len: 1304 microversion: 2.1 time: 0.174292 Sep 20 22:25:12.481123 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 106/218] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:12 2022] GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e => generated 1304 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:12.775603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-07641028-fecd-49e3-ba43-9b513c02e1df req-9224e9b9-7a90-46c1-88af-46046bfca968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "073337e5-2eca-4195-a350-435ee3ff2fe7", "name": "network-vif-deleted", "tag": "129be773-664e-42a2-b7d9-454685340602"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:25:12.792700 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-07641028-fecd-49e3-ba43-9b513c02e1df req-9224e9b9-7a90-46c1-88af-46046bfca968 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:12.793790 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-07641028-fecd-49e3-ba43-9b513c02e1df req-9224e9b9-7a90-46c1-88af-46046bfca968 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:12.794613 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-07641028-fecd-49e3-ba43-9b513c02e1df req-9224e9b9-7a90-46c1-88af-46046bfca968 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:12.820579 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-07641028-fecd-49e3-ba43-9b513c02e1df req-9224e9b9-7a90-46c1-88af-46046bfca968 service nova] Creating event network-vif-deleted:129be773-664e-42a2-b7d9-454685340602 for instance 073337e5-2eca-4195-a350-435ee3ff2fe7 on hv-cinder-85827 Sep 20 22:25:12.831974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-07641028-fecd-49e3-ba43-9b513c02e1df req-9224e9b9-7a90-46c1-88af-46046bfca968 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060822 Sep 20 22:25:12.833514 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 113/219] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:25:12.897896 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-057edf59-6842-4d77-a3e2-13e7c1aebb78 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:12.898558 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-057edf59-6842-4d77-a3e2-13e7c1aebb78 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:12.914292 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-057edf59-6842-4d77-a3e2-13e7c1aebb78 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:12.914292 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-057edf59-6842-4d77-a3e2-13e7c1aebb78 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:12.914292 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-057edf59-6842-4d77-a3e2-13e7c1aebb78 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:12.914292 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-057edf59-6842-4d77-a3e2-13e7c1aebb78 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:12.914662 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-057edf59-6842-4d77-a3e2-13e7c1aebb78 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:12.914662 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-057edf59-6842-4d77-a3e2-13e7c1aebb78 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:13.026012 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-78c9fb77-2d35-497e-8d47-1435026da796 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:13.026715 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-78c9fb77-2d35-497e-8d47-1435026da796 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] [instance: 073337e5-2eca-4195-a350-435ee3ff2fe7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:13.038130 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-78c9fb77-2d35-497e-8d47-1435026da796 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:13.038621 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-78c9fb77-2d35-497e-8d47-1435026da796 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:13.039097 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-78c9fb77-2d35-497e-8d47-1435026da796 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:13.047087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-78c9fb77-2d35-497e-8d47-1435026da796 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:13.047607 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-78c9fb77-2d35-497e-8d47-1435026da796 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:13.048051 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-78c9fb77-2d35-497e-8d47-1435026da796 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:13.114834 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-78c9fb77-2d35-497e-8d47-1435026da796 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:13.115579 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-78c9fb77-2d35-497e-8d47-1435026da796 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:13.116011 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-78c9fb77-2d35-497e-8d47-1435026da796 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:13.116459 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-78c9fb77-2d35-497e-8d47-1435026da796 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lazy-loading 'fault' on Instance uuid 073337e5-2eca-4195-a350-435ee3ff2fe7 {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:25:13.131848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-057edf59-6842-4d77-a3e2-13e7c1aebb78 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:13.143880 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-057edf59-6842-4d77-a3e2-13e7c1aebb78 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.250148 Sep 20 22:25:13.144782 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 107/220] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:12 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:13.174995 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-78c9fb77-2d35-497e-8d47-1435026da796 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0900b908cdb94ccb9c577d814d852fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f356aca02448f8dbbf8c1d190259f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:13.191388 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-78c9fb77-2d35-497e-8d47-1435026da796 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] 10.222.0.16 "GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7" status: 200 len: 1305 microversion: 2.1 time: 0.171264 Sep 20 22:25:13.192123 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 114/221] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:13 2022] GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7 => generated 1305 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:13.477528 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-e3d06bbc-5e1a-4d35-8b17-52aa435e8b5e tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:13.478719 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-e3d06bbc-5e1a-4d35-8b17-52aa435e8b5e tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 269415dc-d013-4c2b-b7a5-7484844e870e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:13.502464 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e3d06bbc-5e1a-4d35-8b17-52aa435e8b5e tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:13.502953 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e3d06bbc-5e1a-4d35-8b17-52aa435e8b5e tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:13.503384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e3d06bbc-5e1a-4d35-8b17-52aa435e8b5e tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:13.504145 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e3d06bbc-5e1a-4d35-8b17-52aa435e8b5e tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:13.504933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e3d06bbc-5e1a-4d35-8b17-52aa435e8b5e tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:13.505622 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e3d06bbc-5e1a-4d35-8b17-52aa435e8b5e tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:13.542776 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-e3d06bbc-5e1a-4d35-8b17-52aa435e8b5e tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] HTTP exception thrown: Instance 269415dc-d013-4c2b-b7a5-7484844e870e could not be found. Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-e3d06bbc-5e1a-4d35-8b17-52aa435e8b5e tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Request method failure captured: Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e HTTP/1.1 Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj2zVwn5MuxUO2f_XuXFjbgPni8KljHdxGCTql1pCsiMMwRP_0FneQkitCKZUSHBA7-d5ZYQzSaqDWPH2zP5JiSifHh7tAVfGTRwQNrxtQ1Sugbs2DVXNmc0ejnRcEPbtCLqqT-msVCBcJBSDAeGM9bQnMgjLcUWb63eZWAXDYLtlG8 Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: fe8853cc9fd0482097a5ac65534d5e58 Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-VolumesActionsTest-213010466 Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:25:13.555114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:25:13.557054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe8853cc9fd0482097a5ac65534d5e58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fe8853cc9fd0482097a5ac65534d5e58", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fe8853cc9fd0482097a5ac65534d5e58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe8853cc9fd0482097a5ac65534d5e58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:25:13.557054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-VolumesActionsTest-213010466 Sep 20 22:25:13.557054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: fe8853cc9fd0482097a5ac65534d5e58 Sep 20 22:25:13.557054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-VolumesActionsTest-213010466 Sep 20 22:25:13.557054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-VolumesActionsTest-213010466-project Sep 20 22:25:13.557054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:25:13.557054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:25:13.557054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 9ff864b8e1434ff895ad20c1615dd328 Sep 20 22:25:13.557054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-VolumesActionsTest-213010466-project Sep 20 22:25:13.557054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:25:13.557054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance 269415dc-d013-4c2b-b7a5-7484844e870e could not be found. Sep 20 22:25:13.557054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': '269415dc-d013-4c2b-b7a5-7484844e870e'} Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 269415dc-d013-4c2b-b7a5-7484844e870e could not be found. Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:25:13.557731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:25:13.558809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:25:13.558809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:25:13.558809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:25:13.558809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:25:13.558809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:25:13.558809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:25:13.558809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:25:13.558809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 269415dc-d013-4c2b-b7a5-7484844e870e could not be found. Sep 20 22:25:13.558809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:25:13.558809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:25:13.558809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:25:13.558809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:25:13.558809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:25:13.558809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:25:13.558809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:25:13.558809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:25:13.558809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 269415dc-d013-4c2b-b7a5-7484844e870e could not be found. Sep 20 22:25:13.558809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:25:13.559763 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-e3d06bbc-5e1a-4d35-8b17-52aa435e8b5e tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Returning 404 to user: Instance 269415dc-d013-4c2b-b7a5-7484844e870e could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:25:13.559763 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-e3d06bbc-5e1a-4d35-8b17-52aa435e8b5e tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e" status: 404 len: 111 microversion: 2.1 time: 0.084778 Sep 20 22:25:13.569243 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 108/222] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:13 2022] GET /compute/v2.1/servers/269415dc-d013-4c2b-b7a5-7484844e870e => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:25:13.703985 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-95ce2efb-6b4e-44e3-9cec-e507f062b513 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1254951256", "imageRef": "a1be001e-c2e4-44b7-b0d2-af96de3855c4", "flavorRef": "452", "networks": [{"uuid": "2bd54fcb-74c2-45c9-8873-bedb4ef2c0ab"}]}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:25:13.768798 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.network.neutron [None req-95ce2efb-6b4e-44e3-9cec-e507f062b513 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] validate_networks() for [('2bd54fcb-74c2-45c9-8873-bedb4ef2c0ab', None, None, None, None, None)] {{(pid=120474) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:25:14.130447 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-95ce2efb-6b4e-44e3-9cec-e507f062b513 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Flavor limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:25:14.130995 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-95ce2efb-6b4e-44e3-9cec-e507f062b513 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Image limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:25:14.131333 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-95ce2efb-6b4e-44e3-9cec-e507f062b513 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Flavor pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:25:14.131743 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-95ce2efb-6b4e-44e3-9cec-e507f062b513 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Image pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:25:14.132158 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-95ce2efb-6b4e-44e3-9cec-e507f062b513 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:25:14.141703 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-95ce2efb-6b4e-44e3-9cec-e507f062b513 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:14.142188 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-95ce2efb-6b4e-44e3-9cec-e507f062b513 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:14.142621 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-95ce2efb-6b4e-44e3-9cec-e507f062b513 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:14.143342 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-95ce2efb-6b4e-44e3-9cec-e507f062b513 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:14.143795 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-95ce2efb-6b4e-44e3-9cec-e507f062b513 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:14.144218 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-95ce2efb-6b4e-44e3-9cec-e507f062b513 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:14.160964 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-95ce2efb-6b4e-44e3-9cec-e507f062b513 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Getting quotas for project fe8853cc9fd0482097a5ac65534d5e58. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:25:14.165354 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-95ce2efb-6b4e-44e3-9cec-e507f062b513 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Getting quotas for user 9ff864b8e1434ff895ad20c1615dd328 and project fe8853cc9fd0482097a5ac65534d5e58. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:25:14.167285 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c37853d0-5d0d-4e22-b8b2-68904db661d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:14.167917 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c37853d0-5d0d-4e22-b8b2-68904db661d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:14.173907 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c37853d0-5d0d-4e22-b8b2-68904db661d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:14.174305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c37853d0-5d0d-4e22-b8b2-68904db661d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:14.174735 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c37853d0-5d0d-4e22-b8b2-68904db661d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:14.175415 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c37853d0-5d0d-4e22-b8b2-68904db661d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:14.175863 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c37853d0-5d0d-4e22-b8b2-68904db661d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:14.176281 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c37853d0-5d0d-4e22-b8b2-68904db661d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:14.177215 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-95ce2efb-6b4e-44e3-9cec-e507f062b513 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Going to run 1 instances... {{(pid=120474) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:25:14.179541 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-95ce2efb-6b4e-44e3-9cec-e507f062b513 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a1be001e-c2e4-44b7-b0d2-af96de3855c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:25:14.228666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-95ce2efb-6b4e-44e3-9cec-e507f062b513 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529397 Sep 20 22:25:14.235221 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 115/223] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:25:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 22:25:14.235221 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-0fdeee64-178f-4839-8c59-94694c7dd1b3 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:14.235221 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-0fdeee64-178f-4839-8c59-94694c7dd1b3 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] [instance: 073337e5-2eca-4195-a350-435ee3ff2fe7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:14.242152 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0fdeee64-178f-4839-8c59-94694c7dd1b3 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:14.242773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0fdeee64-178f-4839-8c59-94694c7dd1b3 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:14.244057 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0fdeee64-178f-4839-8c59-94694c7dd1b3 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:14.245527 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0fdeee64-178f-4839-8c59-94694c7dd1b3 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:14.245527 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0fdeee64-178f-4839-8c59-94694c7dd1b3 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:14.245707 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0fdeee64-178f-4839-8c59-94694c7dd1b3 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:14.260135 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-0fdeee64-178f-4839-8c59-94694c7dd1b3 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] HTTP exception thrown: Instance 073337e5-2eca-4195-a350-435ee3ff2fe7 could not be found. Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-0fdeee64-178f-4839-8c59-94694c7dd1b3 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Request method failure captured: Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7 HTTP/1.1 Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj22aYkgi-S15yrowm7ntvn9E4u-fR_7a7s2tGnXeEf_MSRHp86S961-Thk8SN3XyJxkKSocJj0fJkCl3nMEOEjql_CoIY9ANt8MD1pMY1hGFj2vx6rHlX7zDgr3d7NVyf6rliG6eLkcg30doc_r-hzo04KUJ5R-wCEUw-IYbno6F2U Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: d30f356aca02448f8dbbf8c1d190259f Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-VolumesNegativeTest-943736816 Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:25:14.261823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:25:14.263000 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d30f356aca02448f8dbbf8c1d190259f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d30f356aca02448f8dbbf8c1d190259f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d30f356aca02448f8dbbf8c1d190259f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d30f356aca02448f8dbbf8c1d190259f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:25:14.263000 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-VolumesNegativeTest-943736816 Sep 20 22:25:14.263000 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: d30f356aca02448f8dbbf8c1d190259f Sep 20 22:25:14.263000 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-VolumesNegativeTest-943736816 Sep 20 22:25:14.263000 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-VolumesNegativeTest-943736816-project Sep 20 22:25:14.263000 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:25:14.263000 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:25:14.263000 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 0900b908cdb94ccb9c577d814d852fe7 Sep 20 22:25:14.263000 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-VolumesNegativeTest-943736816-project Sep 20 22:25:14.263000 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:25:14.263000 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance 073337e5-2eca-4195-a350-435ee3ff2fe7 could not be found. Sep 20 22:25:14.263000 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': '073337e5-2eca-4195-a350-435ee3ff2fe7'} Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 073337e5-2eca-4195-a350-435ee3ff2fe7 could not be found. Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:25:14.263666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:25:14.264681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:25:14.264681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:25:14.264681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:25:14.264681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:25:14.264681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:25:14.264681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:25:14.264681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:25:14.264681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 073337e5-2eca-4195-a350-435ee3ff2fe7 could not be found. Sep 20 22:25:14.264681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:25:14.264681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:25:14.264681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:25:14.264681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:25:14.264681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:25:14.264681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:25:14.264681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:25:14.264681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:25:14.264681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 073337e5-2eca-4195-a350-435ee3ff2fe7 could not be found. Sep 20 22:25:14.264681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:25:14.265648 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-0fdeee64-178f-4839-8c59-94694c7dd1b3 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] Returning 404 to user: Instance 073337e5-2eca-4195-a350-435ee3ff2fe7 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:25:14.265648 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-0fdeee64-178f-4839-8c59-94694c7dd1b3 tempest-VolumesNegativeTest-943736816 tempest-VolumesNegativeTest-943736816-project] 10.222.0.16 "GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7" status: 404 len: 111 microversion: 2.1 time: 0.032902 Sep 20 22:25:14.265648 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 116/224] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:14 2022] GET /compute/v2.1/servers/073337e5-2eca-4195-a350-435ee3ff2fe7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:25:14.276520 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-d2d37ee4-80db-40ea-905f-ee6eac283d70 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:14.279241 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-d2d37ee4-80db-40ea-905f-ee6eac283d70 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:14.325134 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c37853d0-5d0d-4e22-b8b2-68904db661d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:14.334893 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-c37853d0-5d0d-4e22-b8b2-68904db661d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.171448 Sep 20 22:25:14.336210 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 109/225] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:14 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:14.339989 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-d2d37ee4-80db-40ea-905f-ee6eac283d70 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:14.347098 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-d2d37ee4-80db-40ea-905f-ee6eac283d70 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4" status: 200 len: 1214 microversion: 2.1 time: 0.082030 Sep 20 22:25:14.355407 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 117/226] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:14 2022] GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:15.361939 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-57d838d9-e4a3-49d7-abe1-c6285de562e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:15.362841 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-57d838d9-e4a3-49d7-abe1-c6285de562e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:15.372112 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-57d838d9-e4a3-49d7-abe1-c6285de562e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:15.372334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f9b6e8eb-7109-4957-a364-87cf2e853775 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:15.372772 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-f9b6e8eb-7109-4957-a364-87cf2e853775 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:15.372871 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-57d838d9-e4a3-49d7-abe1-c6285de562e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:15.373483 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-57d838d9-e4a3-49d7-abe1-c6285de562e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:15.374482 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-57d838d9-e4a3-49d7-abe1-c6285de562e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:15.375772 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-57d838d9-e4a3-49d7-abe1-c6285de562e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:15.376301 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-57d838d9-e4a3-49d7-abe1-c6285de562e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:15.382092 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:15.395066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f9b6e8eb-7109-4957-a364-87cf2e853775 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:15.395575 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f9b6e8eb-7109-4957-a364-87cf2e853775 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:15.396014 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f9b6e8eb-7109-4957-a364-87cf2e853775 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:15.397085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f9b6e8eb-7109-4957-a364-87cf2e853775 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:15.397324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f9b6e8eb-7109-4957-a364-87cf2e853775 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:15.397791 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f9b6e8eb-7109-4957-a364-87cf2e853775 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:15.496175 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-f9b6e8eb-7109-4957-a364-87cf2e853775 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:15.505628 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-f9b6e8eb-7109-4957-a364-87cf2e853775 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4" status: 200 len: 1266 microversion: 2.1 time: 0.138501 Sep 20 22:25:15.506674 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 118/227] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:15 2022] GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:15.545721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-57d838d9-e4a3-49d7-abe1-c6285de562e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:15.568209 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-57d838d9-e4a3-49d7-abe1-c6285de562e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.212774 Sep 20 22:25:15.569640 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 110/228] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:15 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:16.529799 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-899c6ae1-6c3a-48b7-9df9-69181bc315ab tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:16.530421 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-899c6ae1-6c3a-48b7-9df9-69181bc315ab tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:16.544678 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-899c6ae1-6c3a-48b7-9df9-69181bc315ab tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:16.545205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-899c6ae1-6c3a-48b7-9df9-69181bc315ab tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:16.545635 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-899c6ae1-6c3a-48b7-9df9-69181bc315ab tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:16.546329 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-899c6ae1-6c3a-48b7-9df9-69181bc315ab tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:16.546775 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-899c6ae1-6c3a-48b7-9df9-69181bc315ab tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:16.547188 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-899c6ae1-6c3a-48b7-9df9-69181bc315ab tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:16.596258 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-4797176b-ccdb-43d2-8b8a-fb2e36a2e550 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:16.598161 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-4797176b-ccdb-43d2-8b8a-fb2e36a2e550 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:16.606194 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4797176b-ccdb-43d2-8b8a-fb2e36a2e550 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:16.607049 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4797176b-ccdb-43d2-8b8a-fb2e36a2e550 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:16.630086 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4797176b-ccdb-43d2-8b8a-fb2e36a2e550 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:16.630858 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4797176b-ccdb-43d2-8b8a-fb2e36a2e550 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:16.631337 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4797176b-ccdb-43d2-8b8a-fb2e36a2e550 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:16.631875 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4797176b-ccdb-43d2-8b8a-fb2e36a2e550 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:16.855253 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-899c6ae1-6c3a-48b7-9df9-69181bc315ab tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:16.876882 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-899c6ae1-6c3a-48b7-9df9-69181bc315ab tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4" status: 200 len: 1314 microversion: 2.1 time: 0.350676 Sep 20 22:25:16.889255 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 119/229] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:16 2022] GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:17.119503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-4797176b-ccdb-43d2-8b8a-fb2e36a2e550 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:17.127381 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-4797176b-ccdb-43d2-8b8a-fb2e36a2e550 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.535727 Sep 20 22:25:17.128052 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 111/230] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:16 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:17.647520 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-f04e38f9-a835-476c-b86e-b1aba1476daa req-c217a553-bed9-4e77-9362-84dbcad1304f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4", "tag": "47ef4a9d-05e9-4684-b0b8-3c65dd87a427"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:25:17.663139 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-f04e38f9-a835-476c-b86e-b1aba1476daa req-c217a553-bed9-4e77-9362-84dbcad1304f service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:17.663989 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-f04e38f9-a835-476c-b86e-b1aba1476daa req-c217a553-bed9-4e77-9362-84dbcad1304f service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:17.664694 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-f04e38f9-a835-476c-b86e-b1aba1476daa req-c217a553-bed9-4e77-9362-84dbcad1304f service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:17.678710 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-f04e38f9-a835-476c-b86e-b1aba1476daa req-c217a553-bed9-4e77-9362-84dbcad1304f service nova] Creating event network-changed:47ef4a9d-05e9-4684-b0b8-3c65dd87a427 for instance 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 on hv-cinder-85827 Sep 20 22:25:17.685335 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-f04e38f9-a835-476c-b86e-b1aba1476daa req-c217a553-bed9-4e77-9362-84dbcad1304f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040598 Sep 20 22:25:17.686411 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 120/231] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:25:17.914153 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-848cb972-6bb9-4dd3-8c9c-a9dba805fe2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:17.915942 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-848cb972-6bb9-4dd3-8c9c-a9dba805fe2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:17.923619 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-848cb972-6bb9-4dd3-8c9c-a9dba805fe2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:17.924391 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-848cb972-6bb9-4dd3-8c9c-a9dba805fe2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:17.925112 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-848cb972-6bb9-4dd3-8c9c-a9dba805fe2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:17.926009 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-848cb972-6bb9-4dd3-8c9c-a9dba805fe2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:17.926787 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-848cb972-6bb9-4dd3-8c9c-a9dba805fe2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:17.927548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-848cb972-6bb9-4dd3-8c9c-a9dba805fe2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:18.137517 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-848cb972-6bb9-4dd3-8c9c-a9dba805fe2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:18.147983 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-848cb972-6bb9-4dd3-8c9c-a9dba805fe2c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4" status: 200 len: 1314 microversion: 2.1 time: 0.238714 Sep 20 22:25:18.148579 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 112/232] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:17 2022] GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:18.162008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f21258bc-ff81-45d3-b5c2-4b4f3f9eb5a2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:18.163824 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-f21258bc-ff81-45d3-b5c2-4b4f3f9eb5a2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:18.175198 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f21258bc-ff81-45d3-b5c2-4b4f3f9eb5a2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:18.175692 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f21258bc-ff81-45d3-b5c2-4b4f3f9eb5a2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:18.176122 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f21258bc-ff81-45d3-b5c2-4b4f3f9eb5a2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:18.177004 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f21258bc-ff81-45d3-b5c2-4b4f3f9eb5a2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:18.177607 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f21258bc-ff81-45d3-b5c2-4b4f3f9eb5a2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:18.178294 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f21258bc-ff81-45d3-b5c2-4b4f3f9eb5a2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:18.348032 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-f21258bc-ff81-45d3-b5c2-4b4f3f9eb5a2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:18.356262 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-f21258bc-ff81-45d3-b5c2-4b4f3f9eb5a2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.208945 Sep 20 22:25:18.365633 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 121/233] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:18 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:19.172331 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ed21f93d-60fa-4a54-8267-fe01c4c76920 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:19.173861 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ed21f93d-60fa-4a54-8267-fe01c4c76920 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:19.182318 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ed21f93d-60fa-4a54-8267-fe01c4c76920 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:19.183048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ed21f93d-60fa-4a54-8267-fe01c4c76920 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:19.183686 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ed21f93d-60fa-4a54-8267-fe01c4c76920 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:19.184589 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ed21f93d-60fa-4a54-8267-fe01c4c76920 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:19.185249 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ed21f93d-60fa-4a54-8267-fe01c4c76920 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:19.185845 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ed21f93d-60fa-4a54-8267-fe01c4c76920 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:19.354309 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ed21f93d-60fa-4a54-8267-fe01c4c76920 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:19.363892 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ed21f93d-60fa-4a54-8267-fe01c4c76920 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4" status: 200 len: 1314 microversion: 2.1 time: 0.196281 Sep 20 22:25:19.364488 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 113/234] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:19 2022] GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:19.397067 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-45635a0b-d5b4-4957-8466-b6802d40f736 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:19.399296 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-45635a0b-d5b4-4957-8466-b6802d40f736 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:19.408286 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-45635a0b-d5b4-4957-8466-b6802d40f736 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:19.410063 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-45635a0b-d5b4-4957-8466-b6802d40f736 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:19.410723 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-45635a0b-d5b4-4957-8466-b6802d40f736 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:19.411844 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-45635a0b-d5b4-4957-8466-b6802d40f736 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:19.412530 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-45635a0b-d5b4-4957-8466-b6802d40f736 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:19.413113 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-45635a0b-d5b4-4957-8466-b6802d40f736 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:19.440634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:19.732320 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-45635a0b-d5b4-4957-8466-b6802d40f736 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:19.748390 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-45635a0b-d5b4-4957-8466-b6802d40f736 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.366235 Sep 20 22:25:19.754269 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 122/235] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:19 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:20.390657 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8c20412a-692f-43ce-80f7-c57a9d33e9ae tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:20.391332 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8c20412a-692f-43ce-80f7-c57a9d33e9ae tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:20.400119 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8c20412a-692f-43ce-80f7-c57a9d33e9ae tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:20.400838 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8c20412a-692f-43ce-80f7-c57a9d33e9ae tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:20.401660 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8c20412a-692f-43ce-80f7-c57a9d33e9ae tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:20.402591 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8c20412a-692f-43ce-80f7-c57a9d33e9ae tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:20.403403 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8c20412a-692f-43ce-80f7-c57a9d33e9ae tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:20.403861 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8c20412a-692f-43ce-80f7-c57a9d33e9ae tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:20.609519 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-8c20412a-692f-43ce-80f7-c57a9d33e9ae tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:20.620914 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-8c20412a-692f-43ce-80f7-c57a9d33e9ae tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4" status: 200 len: 1314 microversion: 2.1 time: 0.235922 Sep 20 22:25:20.631860 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 114/236] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:20 2022] GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:20.777287 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-36d62b2e-39f1-4074-b3b2-ac8e22570987 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:20.777955 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-36d62b2e-39f1-4074-b3b2-ac8e22570987 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:20.798764 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-36d62b2e-39f1-4074-b3b2-ac8e22570987 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:20.799489 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-36d62b2e-39f1-4074-b3b2-ac8e22570987 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:20.800434 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-36d62b2e-39f1-4074-b3b2-ac8e22570987 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:20.802521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-36d62b2e-39f1-4074-b3b2-ac8e22570987 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:20.803859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-36d62b2e-39f1-4074-b3b2-ac8e22570987 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:20.804631 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-36d62b2e-39f1-4074-b3b2-ac8e22570987 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:21.020991 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-36d62b2e-39f1-4074-b3b2-ac8e22570987 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:21.030290 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-36d62b2e-39f1-4074-b3b2-ac8e22570987 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.261578 Sep 20 22:25:21.031256 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 123/237] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:20 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:21.645795 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-58c65fd0-6ca1-42de-961f-581d2455b765 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:21.646414 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-58c65fd0-6ca1-42de-961f-581d2455b765 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:21.652963 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-58c65fd0-6ca1-42de-961f-581d2455b765 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:21.653471 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-58c65fd0-6ca1-42de-961f-581d2455b765 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:21.653908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-58c65fd0-6ca1-42de-961f-581d2455b765 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:21.654606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-58c65fd0-6ca1-42de-961f-581d2455b765 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:21.655061 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-58c65fd0-6ca1-42de-961f-581d2455b765 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:21.655502 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-58c65fd0-6ca1-42de-961f-581d2455b765 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:21.956921 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-58c65fd0-6ca1-42de-961f-581d2455b765 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:21.965600 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-58c65fd0-6ca1-42de-961f-581d2455b765 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4" status: 200 len: 1314 microversion: 2.1 time: 0.323797 Sep 20 22:25:21.966204 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 115/238] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:21 2022] GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:22.057752 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-dc0c23dc-f2a6-496a-a4c1-10c2d3e6fd24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:22.058959 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-dc0c23dc-f2a6-496a-a4c1-10c2d3e6fd24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:22.074743 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dc0c23dc-f2a6-496a-a4c1-10c2d3e6fd24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:22.078474 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dc0c23dc-f2a6-496a-a4c1-10c2d3e6fd24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:22.079164 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dc0c23dc-f2a6-496a-a4c1-10c2d3e6fd24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:22.080063 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dc0c23dc-f2a6-496a-a4c1-10c2d3e6fd24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:22.080793 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dc0c23dc-f2a6-496a-a4c1-10c2d3e6fd24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:22.082076 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dc0c23dc-f2a6-496a-a4c1-10c2d3e6fd24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:22.261891 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-dc0c23dc-f2a6-496a-a4c1-10c2d3e6fd24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:22.272869 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-dc0c23dc-f2a6-496a-a4c1-10c2d3e6fd24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.221946 Sep 20 22:25:22.273958 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 124/239] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:22 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:22.326464 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-ecdd2bd9-67bb-456d-8adf-838b7e08d1fa req-c3966e4e-70b1-4c67-94d0-1356f00b34aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4", "name": "network-vif-plugged", "status": "completed", "tag": "47ef4a9d-05e9-4684-b0b8-3c65dd87a427"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:25:22.342477 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-ecdd2bd9-67bb-456d-8adf-838b7e08d1fa req-c3966e4e-70b1-4c67-94d0-1356f00b34aa service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:22.345251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-ecdd2bd9-67bb-456d-8adf-838b7e08d1fa req-c3966e4e-70b1-4c67-94d0-1356f00b34aa service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:22.345251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-ecdd2bd9-67bb-456d-8adf-838b7e08d1fa req-c3966e4e-70b1-4c67-94d0-1356f00b34aa service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:22.369369 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-ecdd2bd9-67bb-456d-8adf-838b7e08d1fa req-c3966e4e-70b1-4c67-94d0-1356f00b34aa service nova] Creating event network-vif-plugged:47ef4a9d-05e9-4684-b0b8-3c65dd87a427 for instance 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 on hv-cinder-85827 Sep 20 22:25:22.393192 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-ecdd2bd9-67bb-456d-8adf-838b7e08d1fa req-c3966e4e-70b1-4c67-94d0-1356f00b34aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070243 Sep 20 22:25:22.393806 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 116/240] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:25:22.990433 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-369b0690-ea99-4152-bd73-69df2d0d46ad tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:22.991354 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-369b0690-ea99-4152-bd73-69df2d0d46ad tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:22.998164 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-369b0690-ea99-4152-bd73-69df2d0d46ad tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:22.998954 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-369b0690-ea99-4152-bd73-69df2d0d46ad tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:22.999553 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-369b0690-ea99-4152-bd73-69df2d0d46ad tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:23.000501 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-369b0690-ea99-4152-bd73-69df2d0d46ad tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:23.000889 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-369b0690-ea99-4152-bd73-69df2d0d46ad tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:23.002264 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-369b0690-ea99-4152-bd73-69df2d0d46ad tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:23.298669 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-92fcebc5-3a3a-4345-9fe2-56eeff036827 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:23.300410 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-92fcebc5-3a3a-4345-9fe2-56eeff036827 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:23.314298 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92fcebc5-3a3a-4345-9fe2-56eeff036827 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:23.316153 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92fcebc5-3a3a-4345-9fe2-56eeff036827 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:23.316995 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92fcebc5-3a3a-4345-9fe2-56eeff036827 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:23.318175 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92fcebc5-3a3a-4345-9fe2-56eeff036827 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:23.319138 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92fcebc5-3a3a-4345-9fe2-56eeff036827 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:23.319860 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92fcebc5-3a3a-4345-9fe2-56eeff036827 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:23.371617 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-369b0690-ea99-4152-bd73-69df2d0d46ad tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:23.384457 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-369b0690-ea99-4152-bd73-69df2d0d46ad tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4" status: 200 len: 1314 microversion: 2.1 time: 0.397188 Sep 20 22:25:23.385180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 125/241] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:22 2022] GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:23.614209 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-92fcebc5-3a3a-4345-9fe2-56eeff036827 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:23.626990 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-92fcebc5-3a3a-4345-9fe2-56eeff036827 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.334678 Sep 20 22:25:23.628444 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 117/242] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:23 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:24.406713 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b8cc06be-41bb-4105-afcb-89bce35b0e9c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:24.407351 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b8cc06be-41bb-4105-afcb-89bce35b0e9c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:24.409521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=2 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:24.410816 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=8 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:24.419922 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8cc06be-41bb-4105-afcb-89bce35b0e9c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:24.420673 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8cc06be-41bb-4105-afcb-89bce35b0e9c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:24.421694 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8cc06be-41bb-4105-afcb-89bce35b0e9c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:24.422671 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8cc06be-41bb-4105-afcb-89bce35b0e9c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:24.423121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8cc06be-41bb-4105-afcb-89bce35b0e9c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:24.423836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8cc06be-41bb-4105-afcb-89bce35b0e9c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:24.590437 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b8cc06be-41bb-4105-afcb-89bce35b0e9c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:24.607272 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b8cc06be-41bb-4105-afcb-89bce35b0e9c tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4" status: 200 len: 1314 microversion: 2.1 time: 0.204446 Sep 20 22:25:24.608347 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 126/243] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:24 2022] GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:24.674675 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-293bed85-e981-45fe-b43f-04a9f76806ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:24.677379 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-293bed85-e981-45fe-b43f-04a9f76806ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:24.690344 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-293bed85-e981-45fe-b43f-04a9f76806ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:24.690921 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-293bed85-e981-45fe-b43f-04a9f76806ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:24.691425 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-293bed85-e981-45fe-b43f-04a9f76806ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:24.692368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-293bed85-e981-45fe-b43f-04a9f76806ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:24.692891 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-293bed85-e981-45fe-b43f-04a9f76806ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:24.693482 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-293bed85-e981-45fe-b43f-04a9f76806ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:24.755843 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-e6c04b6d-90c0-4131-b6f2-c47c488bd2c5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:24.756586 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-e6c04b6d-90c0-4131-b6f2-c47c488bd2c5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:24.763620 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e6c04b6d-90c0-4131-b6f2-c47c488bd2c5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:24.764343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e6c04b6d-90c0-4131-b6f2-c47c488bd2c5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:24.764988 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e6c04b6d-90c0-4131-b6f2-c47c488bd2c5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:24.765855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e6c04b6d-90c0-4131-b6f2-c47c488bd2c5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:24.766652 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e6c04b6d-90c0-4131-b6f2-c47c488bd2c5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:24.767235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e6c04b6d-90c0-4131-b6f2-c47c488bd2c5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:24.804793 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-e6c04b6d-90c0-4131-b6f2-c47c488bd2c5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0/ips" status: 200 len: 146 microversion: 2.1 time: 0.052950 Sep 20 22:25:24.809916 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 127/244] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 20 22:25:24 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0/ips => generated 146 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:25:24.881360 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-293bed85-e981-45fe-b43f-04a9f76806ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:24.890467 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-293bed85-e981-45fe-b43f-04a9f76806ac tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.242947 Sep 20 22:25:24.891320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 118/245] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:24 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:25.631002 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-abf3ae59-1a0a-410e-95d9-496b0918e362 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:25.632824 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-abf3ae59-1a0a-410e-95d9-496b0918e362 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:25.645810 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-abf3ae59-1a0a-410e-95d9-496b0918e362 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:25.646669 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-abf3ae59-1a0a-410e-95d9-496b0918e362 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:25.647575 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-abf3ae59-1a0a-410e-95d9-496b0918e362 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:25.648547 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-abf3ae59-1a0a-410e-95d9-496b0918e362 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:25.649236 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-abf3ae59-1a0a-410e-95d9-496b0918e362 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:25.651081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-abf3ae59-1a0a-410e-95d9-496b0918e362 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:25.916653 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d50bf275-9af7-4e57-8837-00607ad9e097 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:25.920176 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d50bf275-9af7-4e57-8837-00607ad9e097 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:25.926866 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d50bf275-9af7-4e57-8837-00607ad9e097 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:25.927347 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d50bf275-9af7-4e57-8837-00607ad9e097 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:25.927787 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d50bf275-9af7-4e57-8837-00607ad9e097 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:25.928483 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d50bf275-9af7-4e57-8837-00607ad9e097 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:25.928934 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d50bf275-9af7-4e57-8837-00607ad9e097 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:25.929411 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d50bf275-9af7-4e57-8837-00607ad9e097 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:26.047800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-abf3ae59-1a0a-410e-95d9-496b0918e362 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:26.061360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-abf3ae59-1a0a-410e-95d9-496b0918e362 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4" status: 200 len: 1314 microversion: 2.1 time: 0.433843 Sep 20 22:25:26.079014 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 128/246] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:25 2022] GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:26.157373 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-d50bf275-9af7-4e57-8837-00607ad9e097 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:26.170490 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-d50bf275-9af7-4e57-8837-00607ad9e097 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.257989 Sep 20 22:25:26.174899 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 119/247] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:25 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:27.090863 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-33e4a9d4-c490-4825-bf62-0a4c995e4230 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:27.092836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-33e4a9d4-c490-4825-bf62-0a4c995e4230 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:27.104848 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-33e4a9d4-c490-4825-bf62-0a4c995e4230 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:27.106560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-33e4a9d4-c490-4825-bf62-0a4c995e4230 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:27.107811 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-33e4a9d4-c490-4825-bf62-0a4c995e4230 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:27.110479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-33e4a9d4-c490-4825-bf62-0a4c995e4230 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:27.111177 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-33e4a9d4-c490-4825-bf62-0a4c995e4230 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:27.112905 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-33e4a9d4-c490-4825-bf62-0a4c995e4230 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:27.210826 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ae498865-c995-4dc8-9ead-8268c9460c7f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:27.212604 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ae498865-c995-4dc8-9ead-8268c9460c7f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:27.230218 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ae498865-c995-4dc8-9ead-8268c9460c7f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:27.234226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ae498865-c995-4dc8-9ead-8268c9460c7f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:27.235005 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ae498865-c995-4dc8-9ead-8268c9460c7f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:27.236140 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ae498865-c995-4dc8-9ead-8268c9460c7f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:27.239106 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ae498865-c995-4dc8-9ead-8268c9460c7f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:27.241009 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ae498865-c995-4dc8-9ead-8268c9460c7f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:27.648297 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ae498865-c995-4dc8-9ead-8268c9460c7f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:27.674214 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ae498865-c995-4dc8-9ead-8268c9460c7f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1520 microversion: 2.1 time: 0.477797 Sep 20 22:25:27.675466 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 120/248] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:27 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1520 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:27.721992 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-33e4a9d4-c490-4825-bf62-0a4c995e4230 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:27.732902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-33e4a9d4-c490-4825-bf62-0a4c995e4230 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4" status: 200 len: 1314 microversion: 2.1 time: 0.646801 Sep 20 22:25:27.746830 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 129/249] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:27 2022] GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:28.706865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-902d83b1-f20e-4295-b7ed-03d5dfca0210 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:28.708005 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-902d83b1-f20e-4295-b7ed-03d5dfca0210 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:28.730018 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-902d83b1-f20e-4295-b7ed-03d5dfca0210 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:28.731475 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-902d83b1-f20e-4295-b7ed-03d5dfca0210 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:28.733579 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-902d83b1-f20e-4295-b7ed-03d5dfca0210 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:28.734894 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-902d83b1-f20e-4295-b7ed-03d5dfca0210 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:28.737685 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-902d83b1-f20e-4295-b7ed-03d5dfca0210 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:28.738325 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-902d83b1-f20e-4295-b7ed-03d5dfca0210 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:28.777661 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-36f61989-4792-4444-b950-59d76f04bdc4 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:28.778933 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-36f61989-4792-4444-b950-59d76f04bdc4 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:28.795947 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-36f61989-4792-4444-b950-59d76f04bdc4 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:28.797329 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-36f61989-4792-4444-b950-59d76f04bdc4 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:28.798852 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-36f61989-4792-4444-b950-59d76f04bdc4 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:28.802373 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-36f61989-4792-4444-b950-59d76f04bdc4 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:28.803070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-36f61989-4792-4444-b950-59d76f04bdc4 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:28.804822 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-36f61989-4792-4444-b950-59d76f04bdc4 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:29.099944 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-902d83b1-f20e-4295-b7ed-03d5dfca0210 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:29.109261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-902d83b1-f20e-4295-b7ed-03d5dfca0210 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1500 microversion: 2.1 time: 0.411455 Sep 20 22:25:29.132349 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 121/250] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:28 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1500 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:29.151928 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-4b75a936-ca37-40f5-a22b-11dc240f253e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89ae9b1f-da21-4d79-89e6-ae8fcbdd23a9"}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:25:29.161575 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-4b75a936-ca37-40f5-a22b-11dc240f253e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:29.187971 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4b75a936-ca37-40f5-a22b-11dc240f253e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:29.188862 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4b75a936-ca37-40f5-a22b-11dc240f253e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:29.190213 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4b75a936-ca37-40f5-a22b-11dc240f253e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:29.191170 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4b75a936-ca37-40f5-a22b-11dc240f253e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:29.191783 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4b75a936-ca37-40f5-a22b-11dc240f253e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:29.192357 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4b75a936-ca37-40f5-a22b-11dc240f253e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:29.211662 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-36f61989-4792-4444-b950-59d76f04bdc4 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:29.228238 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-36f61989-4792-4444-b950-59d76f04bdc4 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4" status: 200 len: 1498 microversion: 2.1 time: 0.455742 Sep 20 22:25:29.230766 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 130/251] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:28 2022] GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 => generated 1498 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:29.245451 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-db7a1bbe-d86d-4188-a1d9-3ffe4ec58620 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:29.248259 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-db7a1bbe-d86d-4188-a1d9-3ffe4ec58620 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:29.266068 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-db7a1bbe-d86d-4188-a1d9-3ffe4ec58620 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:29.267980 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-db7a1bbe-d86d-4188-a1d9-3ffe4ec58620 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:29.269523 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-db7a1bbe-d86d-4188-a1d9-3ffe4ec58620 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:29.272045 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-db7a1bbe-d86d-4188-a1d9-3ffe4ec58620 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:29.272599 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-db7a1bbe-d86d-4188-a1d9-3ffe4ec58620 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:29.275350 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-db7a1bbe-d86d-4188-a1d9-3ffe4ec58620 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:29.562550 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-db7a1bbe-d86d-4188-a1d9-3ffe4ec58620 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:29.588439 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-db7a1bbe-d86d-4188-a1d9-3ffe4ec58620 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1514 microversion: 2.1 time: 0.352928 Sep 20 22:25:29.590864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 131/252] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:29 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1514 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:29.831703 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-4b75a936-ca37-40f5-a22b-11dc240f253e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "POST /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.695516 Sep 20 22:25:29.832915 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 122/253] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 20 22:25:29 2022] POST /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0/os-volume_attachments => generated 194 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:25:30.182023 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3895dab8-76f8-4d71-bb91-ba3903893165 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:30.183887 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-3895dab8-76f8-4d71-bb91-ba3903893165 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:30.205293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3895dab8-76f8-4d71-bb91-ba3903893165 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:30.207731 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3895dab8-76f8-4d71-bb91-ba3903893165 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:30.209497 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3895dab8-76f8-4d71-bb91-ba3903893165 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:30.212162 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3895dab8-76f8-4d71-bb91-ba3903893165 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:30.213811 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3895dab8-76f8-4d71-bb91-ba3903893165 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:30.215921 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3895dab8-76f8-4d71-bb91-ba3903893165 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:30.290645 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-3895dab8-76f8-4d71-bb91-ba3903893165 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] Going to try to terminate instance {{(pid=120474) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:25:30.472265 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-3895dab8-76f8-4d71-bb91-ba3903893165 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4" status: 204 len: 0 microversion: 2.1 time: 0.295038 Sep 20 22:25:30.473144 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 132/254] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:25:30 2022] DELETE /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:25:30.482200 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0fc1ac7b-1fd7-4fe6-a852-976398a77773 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:30.482951 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-0fc1ac7b-1fd7-4fe6-a852-976398a77773 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:30.491707 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0fc1ac7b-1fd7-4fe6-a852-976398a77773 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:30.495927 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0fc1ac7b-1fd7-4fe6-a852-976398a77773 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:30.497597 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0fc1ac7b-1fd7-4fe6-a852-976398a77773 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:30.498654 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0fc1ac7b-1fd7-4fe6-a852-976398a77773 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:30.500785 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0fc1ac7b-1fd7-4fe6-a852-976398a77773 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:30.501544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0fc1ac7b-1fd7-4fe6-a852-976398a77773 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:30.741138 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-0fc1ac7b-1fd7-4fe6-a852-976398a77773 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:30.752494 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-0fc1ac7b-1fd7-4fe6-a852-976398a77773 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4" status: 200 len: 1504 microversion: 2.1 time: 0.274516 Sep 20 22:25:30.753711 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 123/255] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:30 2022] GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 => generated 1504 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:31.419549 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-095862dd-7b1b-4611-b94c-1971b816f350 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:25:31.423743 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-095862dd-7b1b-4611-b94c-1971b816f350 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:31.435077 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-095862dd-7b1b-4611-b94c-1971b816f350 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:31.436376 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-095862dd-7b1b-4611-b94c-1971b816f350 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:31.436825 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-095862dd-7b1b-4611-b94c-1971b816f350 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:31.437566 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-095862dd-7b1b-4611-b94c-1971b816f350 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:31.438368 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-095862dd-7b1b-4611-b94c-1971b816f350 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:31.438998 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-095862dd-7b1b-4611-b94c-1971b816f350 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:31.486029 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-095862dd-7b1b-4611-b94c-1971b816f350 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lazy-loading 'flavor' on Instance uuid 7b72562d-a97c-4822-bb23-f96a857ce91e {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:25:31.589843 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-095862dd-7b1b-4611-b94c-1971b816f350 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "POST /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e/action" status: 200 len: 32 microversion: 2.1 time: 0.186943 Sep 20 22:25:31.594786 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 133/256] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 20 22:25:31 2022] POST /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 20 22:25:31.601047 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-2cee9c92-44eb-44a0-ac45-b5a33f78c8b0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:31.601985 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-2cee9c92-44eb-44a0-ac45-b5a33f78c8b0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:31.609061 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2cee9c92-44eb-44a0-ac45-b5a33f78c8b0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:31.609729 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2cee9c92-44eb-44a0-ac45-b5a33f78c8b0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:31.610510 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2cee9c92-44eb-44a0-ac45-b5a33f78c8b0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:31.611213 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2cee9c92-44eb-44a0-ac45-b5a33f78c8b0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:31.611659 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2cee9c92-44eb-44a0-ac45-b5a33f78c8b0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:31.612072 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2cee9c92-44eb-44a0-ac45-b5a33f78c8b0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:31.780255 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5086b3e8-60a1-4ec0-af25-e530e67c5dd2 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:31.780956 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5086b3e8-60a1-4ec0-af25-e530e67c5dd2 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:31.787267 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5086b3e8-60a1-4ec0-af25-e530e67c5dd2 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:31.788041 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5086b3e8-60a1-4ec0-af25-e530e67c5dd2 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:31.788689 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5086b3e8-60a1-4ec0-af25-e530e67c5dd2 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:31.789624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5086b3e8-60a1-4ec0-af25-e530e67c5dd2 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:31.790349 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5086b3e8-60a1-4ec0-af25-e530e67c5dd2 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:31.791004 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5086b3e8-60a1-4ec0-af25-e530e67c5dd2 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:31.905399 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-2cee9c92-44eb-44a0-ac45-b5a33f78c8b0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:31.913617 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-2cee9c92-44eb-44a0-ac45-b5a33f78c8b0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.317530 Sep 20 22:25:31.914274 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 124/257] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:31 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:32.078404 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-5086b3e8-60a1-4ec0-af25-e530e67c5dd2 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:32.114930 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5086b3e8-60a1-4ec0-af25-e530e67c5dd2 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4" status: 200 len: 1504 microversion: 2.1 time: 0.340710 Sep 20 22:25:32.120295 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 134/258] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:31 2022] GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 => generated 1504 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:32.939044 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-3c40913f-56f5-40dc-b20f-5bb3972287f2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:32.939737 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-3c40913f-56f5-40dc-b20f-5bb3972287f2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:32.950406 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3c40913f-56f5-40dc-b20f-5bb3972287f2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:32.952661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3c40913f-56f5-40dc-b20f-5bb3972287f2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:32.953617 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3c40913f-56f5-40dc-b20f-5bb3972287f2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:32.958547 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3c40913f-56f5-40dc-b20f-5bb3972287f2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:32.959337 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3c40913f-56f5-40dc-b20f-5bb3972287f2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:32.961756 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3c40913f-56f5-40dc-b20f-5bb3972287f2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:33.143375 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-06b6afb8-941e-4230-a3fa-90774c5cca49 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:33.147167 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-06b6afb8-941e-4230-a3fa-90774c5cca49 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:33.155874 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-06b6afb8-941e-4230-a3fa-90774c5cca49 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:33.156599 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-06b6afb8-941e-4230-a3fa-90774c5cca49 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:33.157243 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-06b6afb8-941e-4230-a3fa-90774c5cca49 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:33.158149 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-06b6afb8-941e-4230-a3fa-90774c5cca49 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:33.158798 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-06b6afb8-941e-4230-a3fa-90774c5cca49 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:33.159222 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-06b6afb8-941e-4230-a3fa-90774c5cca49 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:33.240155 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-3c40913f-56f5-40dc-b20f-5bb3972287f2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:33.251387 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-06b6afb8-941e-4230-a3fa-90774c5cca49 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff864b8e1434ff895ad20c1615dd328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8853cc9fd0482097a5ac65534d5e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:33.254527 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-3c40913f-56f5-40dc-b20f-5bb3972287f2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.321916 Sep 20 22:25:33.257704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:33.260213 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 125/259] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:32 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:33.262618 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-06b6afb8-941e-4230-a3fa-90774c5cca49 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4" status: 200 len: 1462 microversion: 2.1 time: 0.123016 Sep 20 22:25:33.263652 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 135/260] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:33 2022] GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 => generated 1462 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:33.271563 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-d201e757-1e69-4412-b724-6c6e74952de4 req-4c1d93d6-4a82-4865-b413-7342373bfc50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4", "name": "network-vif-deleted", "tag": "47ef4a9d-05e9-4684-b0b8-3c65dd87a427"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:25:33.303498 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-d201e757-1e69-4412-b724-6c6e74952de4 req-4c1d93d6-4a82-4865-b413-7342373bfc50 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:33.304926 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-d201e757-1e69-4412-b724-6c6e74952de4 req-4c1d93d6-4a82-4865-b413-7342373bfc50 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:33.306600 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-d201e757-1e69-4412-b724-6c6e74952de4 req-4c1d93d6-4a82-4865-b413-7342373bfc50 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:33.338378 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:33.340849 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-d201e757-1e69-4412-b724-6c6e74952de4 req-4c1d93d6-4a82-4865-b413-7342373bfc50 service nova] Creating event network-vif-deleted:47ef4a9d-05e9-4684-b0b8-3c65dd87a427 for instance 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 on hv-cinder-85827 Sep 20 22:25:33.352448 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-d201e757-1e69-4412-b724-6c6e74952de4 req-4c1d93d6-4a82-4865-b413-7342373bfc50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090331 Sep 20 22:25:33.353388 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 126/261] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:25:33.578099 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-d2bf0380-b6f8-4a1a-9f1a-dafdb847ddef tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Action: 'create', calling method: .version_select at 0x7f24f693ef70>, body: {"keypair": {"name": "tempest-TestShelveInstance-171289814", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ28TcVueXljMB1SUezmkEZ4Z01I9NWzbEz0Nbu4II2JMRio9DP9G/fXFJG6bvA3S4qqXq5HcN8Tpt9ayRh8/OGzNrQXpJTUqMXKBos3iGFPwPt1EDFPC+1OzDY9JSnCjQ=="}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:25:33.601924 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-d2bf0380-b6f8-4a1a-9f1a-dafdb847ddef tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Getting quotas for project 99c755c2cb864d05ac8561716aba8ae2. Resources: {'key_pairs'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:25:33.607041 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-d2bf0380-b6f8-4a1a-9f1a-dafdb847ddef tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Getting quotas for user 1c0ce4393b244819aa940ab5cd6b5812 and project 99c755c2cb864d05ac8561716aba8ae2. Resources: {'key_pairs'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:25:33.636643 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-d2bf0380-b6f8-4a1a-9f1a-dafdb847ddef tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.307948 Sep 20 22:25:33.637284 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 136/262] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 20 22:25:33 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:25:34.289011 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c24b22c9-abaf-4908-880b-c14b29f51e82 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:34.289621 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-c24b22c9-abaf-4908-880b-c14b29f51e82 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] [instance: 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:34.295800 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-bd76df3f-1a5c-4896-90a8-76a7e8e9da4e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:34.297116 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-bd76df3f-1a5c-4896-90a8-76a7e8e9da4e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:34.299132 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:34.308416 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c24b22c9-abaf-4908-880b-c14b29f51e82 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:34.310933 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c24b22c9-abaf-4908-880b-c14b29f51e82 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:34.311619 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c24b22c9-abaf-4908-880b-c14b29f51e82 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:34.313931 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bd76df3f-1a5c-4896-90a8-76a7e8e9da4e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:34.314401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bd76df3f-1a5c-4896-90a8-76a7e8e9da4e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:34.314832 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bd76df3f-1a5c-4896-90a8-76a7e8e9da4e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:34.315525 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bd76df3f-1a5c-4896-90a8-76a7e8e9da4e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:34.315969 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bd76df3f-1a5c-4896-90a8-76a7e8e9da4e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:34.316389 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bd76df3f-1a5c-4896-90a8-76a7e8e9da4e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:34.319884 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c24b22c9-abaf-4908-880b-c14b29f51e82 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:34.320551 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c24b22c9-abaf-4908-880b-c14b29f51e82 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:34.321041 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c24b22c9-abaf-4908-880b-c14b29f51e82 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:34.338365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-c24b22c9-abaf-4908-880b-c14b29f51e82 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] HTTP exception thrown: Instance 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 could not be found. Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c24b22c9-abaf-4908-880b-c14b29f51e82 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Request method failure captured: Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 HTTP/1.1 Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj2zVwn5MuxUO2f_XuXFjbgPni8KljHdxGCTql1pCsiMMwRP_0FneQkitCKZUSHBA7-d5ZYQzSaqDWPH2zP5JiSifHh7tAVfGTRwQNrxtQ1Sugbs2DVXNmc0ejnRcEPbtCLqqT-msVCBcJBSDAeGM9bQnMgjLcUWb63eZWAXDYLtlG8 Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: fe8853cc9fd0482097a5ac65534d5e58 Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-VolumesActionsTest-213010466 Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:25:34.340883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:25:34.342430 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe8853cc9fd0482097a5ac65534d5e58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fe8853cc9fd0482097a5ac65534d5e58", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fe8853cc9fd0482097a5ac65534d5e58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe8853cc9fd0482097a5ac65534d5e58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:25:34.342430 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-VolumesActionsTest-213010466 Sep 20 22:25:34.342430 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: fe8853cc9fd0482097a5ac65534d5e58 Sep 20 22:25:34.342430 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-VolumesActionsTest-213010466 Sep 20 22:25:34.342430 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-VolumesActionsTest-213010466-project Sep 20 22:25:34.342430 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:25:34.342430 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:25:34.342430 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 9ff864b8e1434ff895ad20c1615dd328 Sep 20 22:25:34.342430 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-VolumesActionsTest-213010466-project Sep 20 22:25:34.342430 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:25:34.342430 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 could not be found. Sep 20 22:25:34.342430 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': '8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4'} Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 could not be found. Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:25:34.343258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:25:34.344684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:25:34.344684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:25:34.344684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:25:34.344684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:25:34.344684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:25:34.344684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:25:34.344684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:25:34.344684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 could not be found. Sep 20 22:25:34.344684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:25:34.344684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:25:34.344684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:25:34.344684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:25:34.344684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:25:34.344684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:25:34.344684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:25:34.344684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:25:34.344684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 could not be found. Sep 20 22:25:34.344684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:25:34.347097 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c24b22c9-abaf-4908-880b-c14b29f51e82 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] Returning 404 to user: Instance 8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:25:34.348125 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c24b22c9-abaf-4908-880b-c14b29f51e82 tempest-VolumesActionsTest-213010466 tempest-VolumesActionsTest-213010466-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4" status: 404 len: 111 microversion: 2.1 time: 0.063356 Sep 20 22:25:34.365679 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 137/263] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:34 2022] GET /compute/v2.1/servers/8d9a5f7d-5081-4ff1-a48c-421d4ce0f0e4 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:25:34.551575 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-bd76df3f-1a5c-4896-90a8-76a7e8e9da4e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:34.560593 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-bd76df3f-1a5c-4896-90a8-76a7e8e9da4e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.279969 Sep 20 22:25:34.565375 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 127/264] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:34 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:35.583877 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-478b1aa0-7af9-4c71-924d-e8a8dfdaf62c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:35.584576 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-478b1aa0-7af9-4c71-924d-e8a8dfdaf62c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:35.592070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-478b1aa0-7af9-4c71-924d-e8a8dfdaf62c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:35.592624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-478b1aa0-7af9-4c71-924d-e8a8dfdaf62c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:35.593323 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-478b1aa0-7af9-4c71-924d-e8a8dfdaf62c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:35.594202 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-478b1aa0-7af9-4c71-924d-e8a8dfdaf62c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:35.594782 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-478b1aa0-7af9-4c71-924d-e8a8dfdaf62c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:35.595310 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-478b1aa0-7af9-4c71-924d-e8a8dfdaf62c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:35.752267 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-478b1aa0-7af9-4c71-924d-e8a8dfdaf62c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:35.762690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-478b1aa0-7af9-4c71-924d-e8a8dfdaf62c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.182699 Sep 20 22:25:35.772026 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 138/265] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:35 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:36.796335 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d6a15b66-1c3c-4bbd-960e-9e3ca0c0ecff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:36.797665 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d6a15b66-1c3c-4bbd-960e-9e3ca0c0ecff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:36.808007 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d6a15b66-1c3c-4bbd-960e-9e3ca0c0ecff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:36.808507 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d6a15b66-1c3c-4bbd-960e-9e3ca0c0ecff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:36.808947 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d6a15b66-1c3c-4bbd-960e-9e3ca0c0ecff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:36.809676 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d6a15b66-1c3c-4bbd-960e-9e3ca0c0ecff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:36.810136 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d6a15b66-1c3c-4bbd-960e-9e3ca0c0ecff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:36.819928 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d6a15b66-1c3c-4bbd-960e-9e3ca0c0ecff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:37.011020 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-d6a15b66-1c3c-4bbd-960e-9e3ca0c0ecff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:37.019868 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-d6a15b66-1c3c-4bbd-960e-9e3ca0c0ecff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.227527 Sep 20 22:25:37.020601 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 128/266] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:36 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:38.043532 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-6c5c8ee5-7299-4e67-afb9-837ae7212569 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:38.044155 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-6c5c8ee5-7299-4e67-afb9-837ae7212569 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:38.046764 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:38.051933 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6c5c8ee5-7299-4e67-afb9-837ae7212569 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:38.052417 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6c5c8ee5-7299-4e67-afb9-837ae7212569 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:38.052857 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6c5c8ee5-7299-4e67-afb9-837ae7212569 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:38.053649 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6c5c8ee5-7299-4e67-afb9-837ae7212569 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:38.054106 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6c5c8ee5-7299-4e67-afb9-837ae7212569 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:38.054529 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6c5c8ee5-7299-4e67-afb9-837ae7212569 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:38.189348 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6c5c8ee5-7299-4e67-afb9-837ae7212569 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:38.197621 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-6c5c8ee5-7299-4e67-afb9-837ae7212569 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.158034 Sep 20 22:25:38.198183 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 139/267] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:38 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:39.219943 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-227c185c-0032-4e2e-947e-81563b0d80c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:39.219943 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-227c185c-0032-4e2e-947e-81563b0d80c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:39.226895 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-227c185c-0032-4e2e-947e-81563b0d80c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:39.227160 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-227c185c-0032-4e2e-947e-81563b0d80c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:39.227596 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-227c185c-0032-4e2e-947e-81563b0d80c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:39.228296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-227c185c-0032-4e2e-947e-81563b0d80c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:39.228756 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-227c185c-0032-4e2e-947e-81563b0d80c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:39.229203 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-227c185c-0032-4e2e-947e-81563b0d80c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:39.360956 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-227c185c-0032-4e2e-947e-81563b0d80c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:39.369283 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-227c185c-0032-4e2e-947e-81563b0d80c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.153790 Sep 20 22:25:39.369850 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 129/268] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:39 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:39.834171 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9b44d019-0d31-4cd8-b935-1135dcd72ea8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:25:39.841444 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9b44d019-0d31-4cd8-b935-1135dcd72ea8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:39.841924 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9b44d019-0d31-4cd8-b935-1135dcd72ea8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:39.842346 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9b44d019-0d31-4cd8-b935-1135dcd72ea8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:39.902973 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9b44d019-0d31-4cd8-b935-1135dcd72ea8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Going to try to stop instance {{(pid=120474) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 20 22:25:39.951806 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-9b44d019-0d31-4cd8-b935-1135dcd72ea8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "POST /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0/action" status: 202 len: 0 microversion: 2.1 time: 0.120942 Sep 20 22:25:39.952414 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 140/269] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 20 22:25:39 2022] POST /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:25:39.961373 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b88d6de7-9c48-43d9-a9d8-7d1f43c0c62b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:39.963044 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b88d6de7-9c48-43d9-a9d8-7d1f43c0c62b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:39.971138 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b88d6de7-9c48-43d9-a9d8-7d1f43c0c62b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:39.971523 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b88d6de7-9c48-43d9-a9d8-7d1f43c0c62b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:39.971965 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b88d6de7-9c48-43d9-a9d8-7d1f43c0c62b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:39.972775 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b88d6de7-9c48-43d9-a9d8-7d1f43c0c62b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:39.973359 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b88d6de7-9c48-43d9-a9d8-7d1f43c0c62b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:39.973713 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b88d6de7-9c48-43d9-a9d8-7d1f43c0c62b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:40.120332 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b88d6de7-9c48-43d9-a9d8-7d1f43c0c62b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:40.129351 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b88d6de7-9c48-43d9-a9d8-7d1f43c0c62b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1723 microversion: 2.1 time: 0.171830 Sep 20 22:25:40.129979 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 130/270] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:39 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:40.392362 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-dbca2d10-b099-41f7-b0d2-1831183ce33b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:40.398406 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-dbca2d10-b099-41f7-b0d2-1831183ce33b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:40.405781 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dbca2d10-b099-41f7-b0d2-1831183ce33b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:40.406598 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dbca2d10-b099-41f7-b0d2-1831183ce33b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:40.407281 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dbca2d10-b099-41f7-b0d2-1831183ce33b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:40.408067 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dbca2d10-b099-41f7-b0d2-1831183ce33b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:40.408607 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dbca2d10-b099-41f7-b0d2-1831183ce33b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:40.409251 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dbca2d10-b099-41f7-b0d2-1831183ce33b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:40.590732 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-dbca2d10-b099-41f7-b0d2-1831183ce33b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:40.601811 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-dbca2d10-b099-41f7-b0d2-1831183ce33b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.213601 Sep 20 22:25:40.614167 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 141/271] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:40 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:41.090340 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-92bc6652-92b7-47f0-b401-1721b48c02bb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:41.090921 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-92bc6652-92b7-47f0-b401-1721b48c02bb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:41.097840 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92bc6652-92b7-47f0-b401-1721b48c02bb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:41.098323 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92bc6652-92b7-47f0-b401-1721b48c02bb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:41.098753 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92bc6652-92b7-47f0-b401-1721b48c02bb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:41.099447 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92bc6652-92b7-47f0-b401-1721b48c02bb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:41.099985 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92bc6652-92b7-47f0-b401-1721b48c02bb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:41.100415 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92bc6652-92b7-47f0-b401-1721b48c02bb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:41.125455 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-92bc6652-92b7-47f0-b401-1721b48c02bb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/ips" status: 200 len: 151 microversion: 2.20 time: 0.039407 Sep 20 22:25:41.126075 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 131/272] 10.222.0.16 () {60 vars in 1289 bytes} [Tue Sep 20 22:25:41 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:25:41.159657 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-e5b582dd-b434-4960-9379-efb83333ea4d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:41.160566 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-e5b582dd-b434-4960-9379-efb83333ea4d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:41.173878 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e5b582dd-b434-4960-9379-efb83333ea4d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:41.174622 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e5b582dd-b434-4960-9379-efb83333ea4d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:41.175561 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e5b582dd-b434-4960-9379-efb83333ea4d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:41.176612 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e5b582dd-b434-4960-9379-efb83333ea4d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:41.177442 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e5b582dd-b434-4960-9379-efb83333ea4d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:41.178208 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e5b582dd-b434-4960-9379-efb83333ea4d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:41.355485 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-e5b582dd-b434-4960-9379-efb83333ea4d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:41.365552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-e5b582dd-b434-4960-9379-efb83333ea4d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1723 microversion: 2.1 time: 0.210409 Sep 20 22:25:41.366117 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 142/273] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:41 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:41.629328 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-5be0cfca-d35b-417e-befa-04100d61c447 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:41.629932 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-5be0cfca-d35b-417e-befa-04100d61c447 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:41.635828 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5be0cfca-d35b-417e-befa-04100d61c447 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:41.636448 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5be0cfca-d35b-417e-befa-04100d61c447 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:41.636752 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5be0cfca-d35b-417e-befa-04100d61c447 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:41.637467 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5be0cfca-d35b-417e-befa-04100d61c447 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:41.637916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5be0cfca-d35b-417e-befa-04100d61c447 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:41.638332 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5be0cfca-d35b-417e-befa-04100d61c447 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:41.797096 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-5be0cfca-d35b-417e-befa-04100d61c447 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:41.811560 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-5be0cfca-d35b-417e-befa-04100d61c447 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.185953 Sep 20 22:25:41.813638 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 132/274] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:41 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:42.390459 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4eb2f4fa-e81b-4d7a-b5a0-a0b0417b3507 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:42.391409 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4eb2f4fa-e81b-4d7a-b5a0-a0b0417b3507 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:42.399460 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4eb2f4fa-e81b-4d7a-b5a0-a0b0417b3507 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:42.400241 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4eb2f4fa-e81b-4d7a-b5a0-a0b0417b3507 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:42.401111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4eb2f4fa-e81b-4d7a-b5a0-a0b0417b3507 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:42.401864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4eb2f4fa-e81b-4d7a-b5a0-a0b0417b3507 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:42.402366 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4eb2f4fa-e81b-4d7a-b5a0-a0b0417b3507 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:42.402870 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4eb2f4fa-e81b-4d7a-b5a0-a0b0417b3507 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:42.569475 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4eb2f4fa-e81b-4d7a-b5a0-a0b0417b3507 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:42.596129 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4eb2f4fa-e81b-4d7a-b5a0-a0b0417b3507 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1723 microversion: 2.1 time: 0.209978 Sep 20 22:25:42.597041 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 143/275] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:42 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:42.839693 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-cc7cb84d-07b1-4de6-ad7e-c912047f581a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:42.840404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-cc7cb84d-07b1-4de6-ad7e-c912047f581a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:42.847125 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cc7cb84d-07b1-4de6-ad7e-c912047f581a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:42.847861 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cc7cb84d-07b1-4de6-ad7e-c912047f581a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:42.848404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cc7cb84d-07b1-4de6-ad7e-c912047f581a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:42.849376 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cc7cb84d-07b1-4de6-ad7e-c912047f581a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:42.850065 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cc7cb84d-07b1-4de6-ad7e-c912047f581a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:42.850691 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cc7cb84d-07b1-4de6-ad7e-c912047f581a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:43.040541 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-cc7cb84d-07b1-4de6-ad7e-c912047f581a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:43.053745 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-cc7cb84d-07b1-4de6-ad7e-c912047f581a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.217732 Sep 20 22:25:43.054715 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 133/276] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:42 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:43.233256 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f0f564f9-f3f7-4dc9-b0e7-50c13c967137 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:25:43.234182 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-f0f564f9-f3f7-4dc9-b0e7-50c13c967137 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:43.247828 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f0f564f9-f3f7-4dc9-b0e7-50c13c967137 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:43.248319 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f0f564f9-f3f7-4dc9-b0e7-50c13c967137 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:43.248751 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f0f564f9-f3f7-4dc9-b0e7-50c13c967137 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:43.249479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f0f564f9-f3f7-4dc9-b0e7-50c13c967137 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:43.250388 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f0f564f9-f3f7-4dc9-b0e7-50c13c967137 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:43.250822 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f0f564f9-f3f7-4dc9-b0e7-50c13c967137 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:43.281487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-f0f564f9-f3f7-4dc9-b0e7-50c13c967137 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lazy-loading 'flavor' on Instance uuid 48d58779-65b7-4b97-8536-eef4357a475d {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:25:43.618935 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=4 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:43.623867 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0a82591c-d792-44a2-865e-cc5b008b1f52 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:43.624732 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-0a82591c-d792-44a2-865e-cc5b008b1f52 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:43.633997 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0a82591c-d792-44a2-865e-cc5b008b1f52 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:43.634762 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0a82591c-d792-44a2-865e-cc5b008b1f52 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:43.635220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0a82591c-d792-44a2-865e-cc5b008b1f52 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:43.636212 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0a82591c-d792-44a2-865e-cc5b008b1f52 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:43.636855 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0a82591c-d792-44a2-865e-cc5b008b1f52 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:43.637456 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0a82591c-d792-44a2-865e-cc5b008b1f52 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:43.794765 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-0a82591c-d792-44a2-865e-cc5b008b1f52 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:43.806724 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-0a82591c-d792-44a2-865e-cc5b008b1f52 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1723 microversion: 2.1 time: 0.188273 Sep 20 22:25:43.807653 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 134/277] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:43 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:44.079366 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-fc94a970-8aa7-42b8-9013-8c0862f4ccd5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:44.080063 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-fc94a970-8aa7-42b8-9013-8c0862f4ccd5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:44.088378 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fc94a970-8aa7-42b8-9013-8c0862f4ccd5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:44.089195 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fc94a970-8aa7-42b8-9013-8c0862f4ccd5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:44.089827 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fc94a970-8aa7-42b8-9013-8c0862f4ccd5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:44.090727 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fc94a970-8aa7-42b8-9013-8c0862f4ccd5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:44.091373 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fc94a970-8aa7-42b8-9013-8c0862f4ccd5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:44.091984 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fc94a970-8aa7-42b8-9013-8c0862f4ccd5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:44.266759 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-fc94a970-8aa7-42b8-9013-8c0862f4ccd5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:44.278916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-fc94a970-8aa7-42b8-9013-8c0862f4ccd5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.204106 Sep 20 22:25:44.279895 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 135/278] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:44 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:44.833009 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8788b327-b194-4797-97c8-7c78698e9cee tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:44.833949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8788b327-b194-4797-97c8-7c78698e9cee tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:44.860203 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8788b327-b194-4797-97c8-7c78698e9cee tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:44.860809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8788b327-b194-4797-97c8-7c78698e9cee tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:44.861194 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8788b327-b194-4797-97c8-7c78698e9cee tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:44.867091 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8788b327-b194-4797-97c8-7c78698e9cee tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:44.875510 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8788b327-b194-4797-97c8-7c78698e9cee tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:44.877088 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8788b327-b194-4797-97c8-7c78698e9cee tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:45.077676 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-8788b327-b194-4797-97c8-7c78698e9cee tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:45.089963 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-8788b327-b194-4797-97c8-7c78698e9cee tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1723 microversion: 2.1 time: 0.262351 Sep 20 22:25:45.090935 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 136/279] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:44 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:45.303246 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-dd68c167-22f3-4193-8284-88f64436a357 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:45.304854 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-dd68c167-22f3-4193-8284-88f64436a357 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:45.312472 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dd68c167-22f3-4193-8284-88f64436a357 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:45.313479 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dd68c167-22f3-4193-8284-88f64436a357 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:45.314150 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dd68c167-22f3-4193-8284-88f64436a357 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:45.315218 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dd68c167-22f3-4193-8284-88f64436a357 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:45.316000 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dd68c167-22f3-4193-8284-88f64436a357 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:45.316447 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dd68c167-22f3-4193-8284-88f64436a357 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:45.480111 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-dd68c167-22f3-4193-8284-88f64436a357 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:45.492268 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-dd68c167-22f3-4193-8284-88f64436a357 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.192914 Sep 20 22:25:45.492918 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 137/280] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:45 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:46.116340 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0d502540-bd13-4e4e-86c1-6951f17f3f5f tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:46.117072 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-0d502540-bd13-4e4e-86c1-6951f17f3f5f tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:46.123950 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0d502540-bd13-4e4e-86c1-6951f17f3f5f tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:46.124696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0d502540-bd13-4e4e-86c1-6951f17f3f5f tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:46.125626 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0d502540-bd13-4e4e-86c1-6951f17f3f5f tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:46.126541 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0d502540-bd13-4e4e-86c1-6951f17f3f5f tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:46.127203 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0d502540-bd13-4e4e-86c1-6951f17f3f5f tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:46.127625 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0d502540-bd13-4e4e-86c1-6951f17f3f5f tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:46.319352 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-0d502540-bd13-4e4e-86c1-6951f17f3f5f tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:46.328920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-0d502540-bd13-4e4e-86c1-6951f17f3f5f tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1723 microversion: 2.1 time: 0.216985 Sep 20 22:25:46.329522 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 138/281] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:46 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:46.515627 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-1e4e8c3c-97f8-43eb-95d9-074bce549b32 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:46.516301 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-1e4e8c3c-97f8-43eb-95d9-074bce549b32 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:46.523077 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1e4e8c3c-97f8-43eb-95d9-074bce549b32 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:46.523584 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1e4e8c3c-97f8-43eb-95d9-074bce549b32 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:46.524297 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1e4e8c3c-97f8-43eb-95d9-074bce549b32 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:46.524845 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1e4e8c3c-97f8-43eb-95d9-074bce549b32 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:46.525323 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1e4e8c3c-97f8-43eb-95d9-074bce549b32 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:46.525786 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1e4e8c3c-97f8-43eb-95d9-074bce549b32 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:46.709135 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-1e4e8c3c-97f8-43eb-95d9-074bce549b32 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:46.721004 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-1e4e8c3c-97f8-43eb-95d9-074bce549b32 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.209193 Sep 20 22:25:46.737346 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 139/282] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:46 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:47.354558 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-82e268af-723b-49b1-9866-b89e576f0ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:47.355871 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-82e268af-723b-49b1-9866-b89e576f0ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:47.363177 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-82e268af-723b-49b1-9866-b89e576f0ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:47.363877 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-82e268af-723b-49b1-9866-b89e576f0ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:47.366191 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-82e268af-723b-49b1-9866-b89e576f0ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:47.367043 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-82e268af-723b-49b1-9866-b89e576f0ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:47.368090 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-82e268af-723b-49b1-9866-b89e576f0ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:47.368532 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-82e268af-723b-49b1-9866-b89e576f0ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:47.521337 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-82e268af-723b-49b1-9866-b89e576f0ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:47.532486 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-82e268af-723b-49b1-9866-b89e576f0ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1723 microversion: 2.1 time: 0.182544 Sep 20 22:25:47.533611 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 140/283] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:47 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:47.743811 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-32c33b67-076a-4737-8e9e-0fb317f47e8a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:47.744423 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-32c33b67-076a-4737-8e9e-0fb317f47e8a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:47.750536 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32c33b67-076a-4737-8e9e-0fb317f47e8a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:47.751022 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32c33b67-076a-4737-8e9e-0fb317f47e8a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:47.751963 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32c33b67-076a-4737-8e9e-0fb317f47e8a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:47.752668 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32c33b67-076a-4737-8e9e-0fb317f47e8a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:47.753153 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32c33b67-076a-4737-8e9e-0fb317f47e8a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:47.753584 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32c33b67-076a-4737-8e9e-0fb317f47e8a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:48.037705 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-32c33b67-076a-4737-8e9e-0fb317f47e8a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:48.046426 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-32c33b67-076a-4737-8e9e-0fb317f47e8a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.306031 Sep 20 22:25:48.046996 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 141/284] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:47 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:48.561765 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-f9f79b0c-bd1c-44c5-a57d-55eb12807c1d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:48.563484 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-f9f79b0c-bd1c-44c5-a57d-55eb12807c1d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:48.570350 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f9f79b0c-bd1c-44c5-a57d-55eb12807c1d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:48.571483 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f9f79b0c-bd1c-44c5-a57d-55eb12807c1d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:48.571996 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f9f79b0c-bd1c-44c5-a57d-55eb12807c1d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:48.572774 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f9f79b0c-bd1c-44c5-a57d-55eb12807c1d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:48.573516 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f9f79b0c-bd1c-44c5-a57d-55eb12807c1d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:48.574161 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f9f79b0c-bd1c-44c5-a57d-55eb12807c1d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:48.749152 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f9f79b0c-bd1c-44c5-a57d-55eb12807c1d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:48.771143 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-f9f79b0c-bd1c-44c5-a57d-55eb12807c1d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1723 microversion: 2.1 time: 0.209765 Sep 20 22:25:48.772293 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 142/285] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:48 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:49.070844 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-f306ca6e-1788-473f-85e5-8b5a525cbf4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:49.071374 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-f306ca6e-1788-473f-85e5-8b5a525cbf4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:49.079202 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f306ca6e-1788-473f-85e5-8b5a525cbf4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:49.080236 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f306ca6e-1788-473f-85e5-8b5a525cbf4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:49.080887 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f306ca6e-1788-473f-85e5-8b5a525cbf4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:49.082012 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f306ca6e-1788-473f-85e5-8b5a525cbf4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:49.082473 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f306ca6e-1788-473f-85e5-8b5a525cbf4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:49.082898 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f306ca6e-1788-473f-85e5-8b5a525cbf4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:49.243648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f306ca6e-1788-473f-85e5-8b5a525cbf4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:49.245926 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=100 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:49.255740 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-f306ca6e-1788-473f-85e5-8b5a525cbf4c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.189816 Sep 20 22:25:49.256382 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 143/286] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:49 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:49.799956 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-53eed54b-09d2-492a-bb2d-8d127af95097 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:49.813248 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-53eed54b-09d2-492a-bb2d-8d127af95097 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:49.823000 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-53eed54b-09d2-492a-bb2d-8d127af95097 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:49.823503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-53eed54b-09d2-492a-bb2d-8d127af95097 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:49.823942 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-53eed54b-09d2-492a-bb2d-8d127af95097 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:49.824656 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-53eed54b-09d2-492a-bb2d-8d127af95097 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:49.825156 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-53eed54b-09d2-492a-bb2d-8d127af95097 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:49.826992 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-53eed54b-09d2-492a-bb2d-8d127af95097 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:50.099772 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-53eed54b-09d2-492a-bb2d-8d127af95097 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:50.108606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-53eed54b-09d2-492a-bb2d-8d127af95097 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1723 microversion: 2.1 time: 0.313596 Sep 20 22:25:50.118915 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 144/287] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:49 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:50.280904 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0b571334-948d-480f-a5f9-a5f1ac8fb8c2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:50.281791 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-0b571334-948d-480f-a5f9-a5f1ac8fb8c2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:50.290434 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0b571334-948d-480f-a5f9-a5f1ac8fb8c2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:50.290946 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0b571334-948d-480f-a5f9-a5f1ac8fb8c2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:50.291351 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0b571334-948d-480f-a5f9-a5f1ac8fb8c2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:50.292048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0b571334-948d-480f-a5f9-a5f1ac8fb8c2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:50.292682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0b571334-948d-480f-a5f9-a5f1ac8fb8c2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:50.293139 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0b571334-948d-480f-a5f9-a5f1ac8fb8c2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:50.435547 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-0b571334-948d-480f-a5f9-a5f1ac8fb8c2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:50.444801 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-0b571334-948d-480f-a5f9-a5f1ac8fb8c2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.168165 Sep 20 22:25:50.445923 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 145/288] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:50 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:51.141573 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-73fda2d8-d2b0-4dd8-b663-1be295f291a1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:51.142722 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-73fda2d8-d2b0-4dd8-b663-1be295f291a1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:51.158707 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-73fda2d8-d2b0-4dd8-b663-1be295f291a1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:51.159210 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-73fda2d8-d2b0-4dd8-b663-1be295f291a1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:51.159655 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-73fda2d8-d2b0-4dd8-b663-1be295f291a1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:51.160374 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-73fda2d8-d2b0-4dd8-b663-1be295f291a1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:51.160833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-73fda2d8-d2b0-4dd8-b663-1be295f291a1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:51.166307 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-73fda2d8-d2b0-4dd8-b663-1be295f291a1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:51.335952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-73fda2d8-d2b0-4dd8-b663-1be295f291a1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:51.345119 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-73fda2d8-d2b0-4dd8-b663-1be295f291a1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1723 microversion: 2.1 time: 0.214862 Sep 20 22:25:51.346702 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 146/289] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:51 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:51.468271 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-54dacb28-612f-4e00-9cca-420ecea5bc0b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:51.469325 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-54dacb28-612f-4e00-9cca-420ecea5bc0b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:51.476037 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54dacb28-612f-4e00-9cca-420ecea5bc0b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:51.476523 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54dacb28-612f-4e00-9cca-420ecea5bc0b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:51.477011 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54dacb28-612f-4e00-9cca-420ecea5bc0b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:51.477726 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54dacb28-612f-4e00-9cca-420ecea5bc0b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:51.478178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54dacb28-612f-4e00-9cca-420ecea5bc0b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:51.478608 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54dacb28-612f-4e00-9cca-420ecea5bc0b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:51.646171 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-54dacb28-612f-4e00-9cca-420ecea5bc0b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:51.654459 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-54dacb28-612f-4e00-9cca-420ecea5bc0b tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.190296 Sep 20 22:25:51.655110 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 147/290] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:51 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:52.369751 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-56c36cf9-0739-49d9-8c60-b443edd42538 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:52.370524 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-56c36cf9-0739-49d9-8c60-b443edd42538 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:52.377592 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56c36cf9-0739-49d9-8c60-b443edd42538 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:52.378227 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56c36cf9-0739-49d9-8c60-b443edd42538 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:52.378935 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56c36cf9-0739-49d9-8c60-b443edd42538 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:52.379744 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56c36cf9-0739-49d9-8c60-b443edd42538 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:52.380671 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56c36cf9-0739-49d9-8c60-b443edd42538 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:52.381233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56c36cf9-0739-49d9-8c60-b443edd42538 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:52.545824 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-56c36cf9-0739-49d9-8c60-b443edd42538 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:52.557240 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-56c36cf9-0739-49d9-8c60-b443edd42538 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1723 microversion: 2.1 time: 0.191112 Sep 20 22:25:52.558315 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 148/291] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:52 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:52.686996 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-7555edb0-ce90-49e4-8fce-706a89066597 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:52.687663 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-7555edb0-ce90-49e4-8fce-706a89066597 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:52.694035 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7555edb0-ce90-49e4-8fce-706a89066597 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:52.694677 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7555edb0-ce90-49e4-8fce-706a89066597 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:52.695148 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7555edb0-ce90-49e4-8fce-706a89066597 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:52.696384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7555edb0-ce90-49e4-8fce-706a89066597 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:52.697128 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7555edb0-ce90-49e4-8fce-706a89066597 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:52.697575 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7555edb0-ce90-49e4-8fce-706a89066597 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:52.829335 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-7555edb0-ce90-49e4-8fce-706a89066597 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:52.838208 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-7555edb0-ce90-49e4-8fce-706a89066597 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.155138 Sep 20 22:25:52.839393 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 149/292] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:52 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:53.000308 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-f0f564f9-f3f7-4dc9-b0e7-50c13c967137 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "POST /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/action" status: 202 len: 0 microversion: 2.20 time: 9.761124 Sep 20 22:25:53.001884 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 144/293] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Sep 20 22:25:43 2022] POST /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/action => generated 0 bytes in 9774 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:25:53.012003 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6f97a919-98c5-4c15-876b-0e2c4cd28d74 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:53.012627 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-6f97a919-98c5-4c15-876b-0e2c4cd28d74 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:53.019062 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6f97a919-98c5-4c15-876b-0e2c4cd28d74 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:53.019815 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6f97a919-98c5-4c15-876b-0e2c4cd28d74 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:53.020376 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6f97a919-98c5-4c15-876b-0e2c4cd28d74 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:53.021264 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6f97a919-98c5-4c15-876b-0e2c4cd28d74 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:53.021757 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6f97a919-98c5-4c15-876b-0e2c4cd28d74 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:53.022189 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6f97a919-98c5-4c15-876b-0e2c4cd28d74 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:53.177896 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-6f97a919-98c5-4c15-876b-0e2c4cd28d74 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:53.186489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-6f97a919-98c5-4c15-876b-0e2c4cd28d74 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:53.188220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-6f97a919-98c5-4c15-876b-0e2c4cd28d74 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:53.189498 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-6f97a919-98c5-4c15-876b-0e2c4cd28d74 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.181675 Sep 20 22:25:53.190047 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 150/294] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:25:53 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:25:53.583451 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=11 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:53.584333 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:53.589510 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-87059703-8292-42da-b5e7-985e7080ec09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:53.590293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-87059703-8292-42da-b5e7-985e7080ec09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:53.597587 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-87059703-8292-42da-b5e7-985e7080ec09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:53.598073 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-87059703-8292-42da-b5e7-985e7080ec09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:53.598504 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-87059703-8292-42da-b5e7-985e7080ec09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:53.599192 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-87059703-8292-42da-b5e7-985e7080ec09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:53.599643 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-87059703-8292-42da-b5e7-985e7080ec09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:53.600064 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-87059703-8292-42da-b5e7-985e7080ec09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:53.736935 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-87059703-8292-42da-b5e7-985e7080ec09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:53.746035 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-87059703-8292-42da-b5e7-985e7080ec09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1723 microversion: 2.1 time: 0.163487 Sep 20 22:25:53.747877 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 145/295] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:53 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:53.862813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-92a4bc2e-bb83-4a86-aa2d-06d3493993f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:53.863418 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-92a4bc2e-bb83-4a86-aa2d-06d3493993f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:53.890737 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92a4bc2e-bb83-4a86-aa2d-06d3493993f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:53.893092 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92a4bc2e-bb83-4a86-aa2d-06d3493993f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:53.894384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92a4bc2e-bb83-4a86-aa2d-06d3493993f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:53.896890 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92a4bc2e-bb83-4a86-aa2d-06d3493993f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:53.900087 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92a4bc2e-bb83-4a86-aa2d-06d3493993f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:53.900731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92a4bc2e-bb83-4a86-aa2d-06d3493993f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:54.055484 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-92a4bc2e-bb83-4a86-aa2d-06d3493993f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:54.063492 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-92a4bc2e-bb83-4a86-aa2d-06d3493993f4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.205893 Sep 20 22:25:54.065017 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 151/296] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:53 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:54.215567 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-0452afd6-69b4-4bcd-99ab-ebc1e3d81a47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:54.216207 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-0452afd6-69b4-4bcd-99ab-ebc1e3d81a47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:54.222223 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0452afd6-69b4-4bcd-99ab-ebc1e3d81a47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:54.222705 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0452afd6-69b4-4bcd-99ab-ebc1e3d81a47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:54.223142 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0452afd6-69b4-4bcd-99ab-ebc1e3d81a47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:54.223835 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0452afd6-69b4-4bcd-99ab-ebc1e3d81a47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:54.224291 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0452afd6-69b4-4bcd-99ab-ebc1e3d81a47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:54.224717 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0452afd6-69b4-4bcd-99ab-ebc1e3d81a47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:54.359677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-0452afd6-69b4-4bcd-99ab-ebc1e3d81a47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:54.369084 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-0452afd6-69b4-4bcd-99ab-ebc1e3d81a47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:54.370585 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-0452afd6-69b4-4bcd-99ab-ebc1e3d81a47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:54.371887 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-0452afd6-69b4-4bcd-99ab-ebc1e3d81a47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.160439 Sep 20 22:25:54.372446 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 146/297] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:25:54 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:25:54.776212 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-58a19b81-9dd6-4ac1-ae22-9253a0023998 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:54.777248 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-58a19b81-9dd6-4ac1-ae22-9253a0023998 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:54.783322 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-58a19b81-9dd6-4ac1-ae22-9253a0023998 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:54.783822 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-58a19b81-9dd6-4ac1-ae22-9253a0023998 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:54.784447 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-58a19b81-9dd6-4ac1-ae22-9253a0023998 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:54.785163 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-58a19b81-9dd6-4ac1-ae22-9253a0023998 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:54.785631 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-58a19b81-9dd6-4ac1-ae22-9253a0023998 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:54.786058 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-58a19b81-9dd6-4ac1-ae22-9253a0023998 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:54.948053 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-58a19b81-9dd6-4ac1-ae22-9253a0023998 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:54.957271 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-58a19b81-9dd6-4ac1-ae22-9253a0023998 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1723 microversion: 2.1 time: 0.184836 Sep 20 22:25:54.958268 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 152/298] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:54 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:55.086405 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-e5d88c84-de67-4f69-9d1d-1e2fcc313492 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:55.087539 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-e5d88c84-de67-4f69-9d1d-1e2fcc313492 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:55.095438 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e5d88c84-de67-4f69-9d1d-1e2fcc313492 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:55.096476 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e5d88c84-de67-4f69-9d1d-1e2fcc313492 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:55.097166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e5d88c84-de67-4f69-9d1d-1e2fcc313492 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:55.098511 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e5d88c84-de67-4f69-9d1d-1e2fcc313492 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:55.099197 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e5d88c84-de67-4f69-9d1d-1e2fcc313492 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:55.099843 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e5d88c84-de67-4f69-9d1d-1e2fcc313492 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:55.277721 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-e5d88c84-de67-4f69-9d1d-1e2fcc313492 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:55.287723 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-e5d88c84-de67-4f69-9d1d-1e2fcc313492 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.205361 Sep 20 22:25:55.288566 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 147/299] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:55 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:55.399003 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-f0867c3c-26db-4f0c-b73e-43493fe4094b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:55.399854 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-f0867c3c-26db-4f0c-b73e-43493fe4094b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:55.406527 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f0867c3c-26db-4f0c-b73e-43493fe4094b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:55.407192 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f0867c3c-26db-4f0c-b73e-43493fe4094b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:55.407783 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f0867c3c-26db-4f0c-b73e-43493fe4094b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:55.408721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f0867c3c-26db-4f0c-b73e-43493fe4094b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:55.409345 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f0867c3c-26db-4f0c-b73e-43493fe4094b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:55.409918 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f0867c3c-26db-4f0c-b73e-43493fe4094b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:55.566235 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f0867c3c-26db-4f0c-b73e-43493fe4094b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:55.576707 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f0867c3c-26db-4f0c-b73e-43493fe4094b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:55.578354 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f0867c3c-26db-4f0c-b73e-43493fe4094b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:55.579668 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-f0867c3c-26db-4f0c-b73e-43493fe4094b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.185084 Sep 20 22:25:55.580318 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 153/300] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:25:55 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:25:55.980838 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9da8aace-1f70-4aac-93e9-a1fdc00613b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:55.981956 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9da8aace-1f70-4aac-93e9-a1fdc00613b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:55.988941 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9da8aace-1f70-4aac-93e9-a1fdc00613b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:55.989703 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9da8aace-1f70-4aac-93e9-a1fdc00613b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:55.990355 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9da8aace-1f70-4aac-93e9-a1fdc00613b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:55.991534 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9da8aace-1f70-4aac-93e9-a1fdc00613b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:55.992264 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9da8aace-1f70-4aac-93e9-a1fdc00613b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:55.992914 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9da8aace-1f70-4aac-93e9-a1fdc00613b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:56.147477 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-9da8aace-1f70-4aac-93e9-a1fdc00613b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:56.157053 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-9da8aace-1f70-4aac-93e9-a1fdc00613b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1723 microversion: 2.1 time: 0.180573 Sep 20 22:25:56.173315 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 148/301] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:55 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:56.315861 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-50a5b31c-3c16-4eb3-bd3a-bad55f5db1fa tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:56.316844 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-50a5b31c-3c16-4eb3-bd3a-bad55f5db1fa tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:56.326163 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-50a5b31c-3c16-4eb3-bd3a-bad55f5db1fa tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:56.327048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-50a5b31c-3c16-4eb3-bd3a-bad55f5db1fa tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:56.327772 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-50a5b31c-3c16-4eb3-bd3a-bad55f5db1fa tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:56.328779 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-50a5b31c-3c16-4eb3-bd3a-bad55f5db1fa tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:56.329723 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-50a5b31c-3c16-4eb3-bd3a-bad55f5db1fa tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:56.331182 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-50a5b31c-3c16-4eb3-bd3a-bad55f5db1fa tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:56.480206 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-50a5b31c-3c16-4eb3-bd3a-bad55f5db1fa tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:56.492361 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-50a5b31c-3c16-4eb3-bd3a-bad55f5db1fa tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.181903 Sep 20 22:25:56.505526 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 154/302] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:56 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:56.609513 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-fb90b9d6-8571-4b29-9652-a32f6c932eeb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:56.611024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-fb90b9d6-8571-4b29-9652-a32f6c932eeb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:56.618607 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fb90b9d6-8571-4b29-9652-a32f6c932eeb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:56.619498 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fb90b9d6-8571-4b29-9652-a32f6c932eeb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:56.620111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fb90b9d6-8571-4b29-9652-a32f6c932eeb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:56.621069 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fb90b9d6-8571-4b29-9652-a32f6c932eeb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:56.621691 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fb90b9d6-8571-4b29-9652-a32f6c932eeb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:56.622349 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fb90b9d6-8571-4b29-9652-a32f6c932eeb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:56.777069 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-fb90b9d6-8571-4b29-9652-a32f6c932eeb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:56.794163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-fb90b9d6-8571-4b29-9652-a32f6c932eeb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:56.798063 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-fb90b9d6-8571-4b29-9652-a32f6c932eeb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:56.799260 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-fb90b9d6-8571-4b29-9652-a32f6c932eeb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.194764 Sep 20 22:25:56.799819 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 149/303] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:25:56 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:25:57.182371 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-330964a9-8d1b-4ec1-a7fe-f5fb19c134a4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:57.183599 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-330964a9-8d1b-4ec1-a7fe-f5fb19c134a4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:57.191953 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-330964a9-8d1b-4ec1-a7fe-f5fb19c134a4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:57.192784 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-330964a9-8d1b-4ec1-a7fe-f5fb19c134a4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:57.193775 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-330964a9-8d1b-4ec1-a7fe-f5fb19c134a4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:57.194907 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-330964a9-8d1b-4ec1-a7fe-f5fb19c134a4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:57.195793 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-330964a9-8d1b-4ec1-a7fe-f5fb19c134a4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:57.196542 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-330964a9-8d1b-4ec1-a7fe-f5fb19c134a4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:57.382226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-330964a9-8d1b-4ec1-a7fe-f5fb19c134a4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:57.393645 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-330964a9-8d1b-4ec1-a7fe-f5fb19c134a4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1723 microversion: 2.1 time: 0.217215 Sep 20 22:25:57.409003 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 155/304] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:57 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:57.520339 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-8a97a484-e84e-4982-a6a9-80303763f50c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:57.521062 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-8a97a484-e84e-4982-a6a9-80303763f50c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:57.529977 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8a97a484-e84e-4982-a6a9-80303763f50c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:57.530633 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8a97a484-e84e-4982-a6a9-80303763f50c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:57.531162 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8a97a484-e84e-4982-a6a9-80303763f50c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:57.532332 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8a97a484-e84e-4982-a6a9-80303763f50c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:57.532789 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8a97a484-e84e-4982-a6a9-80303763f50c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:57.533705 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8a97a484-e84e-4982-a6a9-80303763f50c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:57.698218 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-8a97a484-e84e-4982-a6a9-80303763f50c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:57.708258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-8a97a484-e84e-4982-a6a9-80303763f50c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.193073 Sep 20 22:25:57.709003 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 150/305] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:57 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:57.827892 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-809d4783-c425-4915-9495-677670b14c42 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:57.828745 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-809d4783-c425-4915-9495-677670b14c42 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:57.834901 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-809d4783-c425-4915-9495-677670b14c42 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:57.835385 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-809d4783-c425-4915-9495-677670b14c42 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:57.836593 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-809d4783-c425-4915-9495-677670b14c42 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:57.837314 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-809d4783-c425-4915-9495-677670b14c42 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:57.837768 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-809d4783-c425-4915-9495-677670b14c42 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:57.838190 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-809d4783-c425-4915-9495-677670b14c42 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:57.978413 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-809d4783-c425-4915-9495-677670b14c42 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:57.989331 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-809d4783-c425-4915-9495-677670b14c42 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:57.991424 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-809d4783-c425-4915-9495-677670b14c42 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:57.993006 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-809d4783-c425-4915-9495-677670b14c42 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.168885 Sep 20 22:25:57.993926 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 156/306] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:25:57 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:25:58.422158 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3b2637bd-f5b7-408d-b84d-b2d6f72c09e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:58.422783 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-3b2637bd-f5b7-408d-b84d-b2d6f72c09e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:58.433140 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b2637bd-f5b7-408d-b84d-b2d6f72c09e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:58.433692 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b2637bd-f5b7-408d-b84d-b2d6f72c09e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:58.434136 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b2637bd-f5b7-408d-b84d-b2d6f72c09e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:58.435116 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b2637bd-f5b7-408d-b84d-b2d6f72c09e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:58.435601 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b2637bd-f5b7-408d-b84d-b2d6f72c09e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:58.435995 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b2637bd-f5b7-408d-b84d-b2d6f72c09e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:58.573341 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3b2637bd-f5b7-408d-b84d-b2d6f72c09e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:58.581646 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-3b2637bd-f5b7-408d-b84d-b2d6f72c09e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1723 microversion: 2.1 time: 0.163764 Sep 20 22:25:58.582657 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 151/307] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:58 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:58.732878 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6b961c4a-bd5b-4580-8b47-10b69baf576a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:58.734387 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-6b961c4a-bd5b-4580-8b47-10b69baf576a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:58.742128 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6b961c4a-bd5b-4580-8b47-10b69baf576a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:58.743458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6b961c4a-bd5b-4580-8b47-10b69baf576a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:58.744103 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6b961c4a-bd5b-4580-8b47-10b69baf576a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:58.745108 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6b961c4a-bd5b-4580-8b47-10b69baf576a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:58.745803 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6b961c4a-bd5b-4580-8b47-10b69baf576a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:58.746483 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6b961c4a-bd5b-4580-8b47-10b69baf576a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:58.922337 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-6b961c4a-bd5b-4580-8b47-10b69baf576a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:58.936134 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-6b961c4a-bd5b-4580-8b47-10b69baf576a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.207590 Sep 20 22:25:58.936961 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 157/308] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:58 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:25:59.022911 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-2e5964a4-0829-4ac1-b288-3c48609897ed tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:59.024146 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-2e5964a4-0829-4ac1-b288-3c48609897ed tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:59.034281 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2e5964a4-0829-4ac1-b288-3c48609897ed tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:59.034978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2e5964a4-0829-4ac1-b288-3c48609897ed tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:59.035690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2e5964a4-0829-4ac1-b288-3c48609897ed tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:59.036665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2e5964a4-0829-4ac1-b288-3c48609897ed tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:59.037554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2e5964a4-0829-4ac1-b288-3c48609897ed tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:59.038204 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2e5964a4-0829-4ac1-b288-3c48609897ed tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:59.201103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-2e5964a4-0829-4ac1-b288-3c48609897ed tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:59.209289 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-2e5964a4-0829-4ac1-b288-3c48609897ed tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:59.210917 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-2e5964a4-0829-4ac1-b288-3c48609897ed tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:59.211959 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-2e5964a4-0829-4ac1-b288-3c48609897ed tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.192975 Sep 20 22:25:59.212525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 152/309] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:25:59 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:25:59.605893 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0d8b80ce-0ee8-4cbd-9e20-1b259daefd53 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:59.606646 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-0d8b80ce-0ee8-4cbd-9e20-1b259daefd53 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:59.613520 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0d8b80ce-0ee8-4cbd-9e20-1b259daefd53 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:59.614003 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0d8b80ce-0ee8-4cbd-9e20-1b259daefd53 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:59.614430 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0d8b80ce-0ee8-4cbd-9e20-1b259daefd53 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:59.615117 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0d8b80ce-0ee8-4cbd-9e20-1b259daefd53 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:59.615825 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0d8b80ce-0ee8-4cbd-9e20-1b259daefd53 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:59.616242 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0d8b80ce-0ee8-4cbd-9e20-1b259daefd53 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:59.765182 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-0d8b80ce-0ee8-4cbd-9e20-1b259daefd53 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:25:59.774131 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-0d8b80ce-0ee8-4cbd-9e20-1b259daefd53 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1723 microversion: 2.1 time: 0.172348 Sep 20 22:25:59.774796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 158/310] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:59 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:25:59.960514 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-341d7a4e-2e76-4c19-93ca-3a12b22da5ec tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:25:59.960670 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-341d7a4e-2e76-4c19-93ca-3a12b22da5ec tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:25:59.975154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-341d7a4e-2e76-4c19-93ca-3a12b22da5ec tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:59.979902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-341d7a4e-2e76-4c19-93ca-3a12b22da5ec tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:59.980392 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-341d7a4e-2e76-4c19-93ca-3a12b22da5ec tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:25:59.981216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-341d7a4e-2e76-4c19-93ca-3a12b22da5ec tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:25:59.981769 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-341d7a4e-2e76-4c19-93ca-3a12b22da5ec tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:25:59.982205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-341d7a4e-2e76-4c19-93ca-3a12b22da5ec tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:00.198236 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-341d7a4e-2e76-4c19-93ca-3a12b22da5ec tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:00.208126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-341d7a4e-2e76-4c19-93ca-3a12b22da5ec tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.252210 Sep 20 22:26:00.208699 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 153/311] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:25:59 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:26:00.236329 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-dac64ac7-986b-4de7-8d2d-695696ed1fbf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1498474156", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-171289814", "security_groups": [{"name": "tempest-secgroup-smoke-2077254554"}], "networks": [{"uuid": "0b600369-ea02-425d-9f5d-51b2980e835e"}], "block_device_mapping_v2": [{"uuid": "bce4c56f-0454-4d92-9b70-77be888dfade", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:26:00.239876 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a362ac9c-224e-4387-8680-17a36344f8de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:00.240851 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a362ac9c-224e-4387-8680-17a36344f8de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:00.247752 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a362ac9c-224e-4387-8680-17a36344f8de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:00.248650 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a362ac9c-224e-4387-8680-17a36344f8de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:00.249194 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a362ac9c-224e-4387-8680-17a36344f8de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:00.250175 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a362ac9c-224e-4387-8680-17a36344f8de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:00.250757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a362ac9c-224e-4387-8680-17a36344f8de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:00.251265 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a362ac9c-224e-4387-8680-17a36344f8de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:00.411412 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.network.neutron [None req-dac64ac7-986b-4de7-8d2d-695696ed1fbf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] validate_networks() for [('0b600369-ea02-425d-9f5d-51b2980e835e', None, None, None, None, None)] {{(pid=120473) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:26:00.449779 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a362ac9c-224e-4387-8680-17a36344f8de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:00.459180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a362ac9c-224e-4387-8680-17a36344f8de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:00.461532 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a362ac9c-224e-4387-8680-17a36344f8de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:00.463014 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a362ac9c-224e-4387-8680-17a36344f8de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.227387 Sep 20 22:26:00.463782 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 154/312] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:00 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:26:00.799513 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-2fe8c3d3-0d25-4985-ae21-ac32bd8d7a17 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:00.800549 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-2fe8c3d3-0d25-4985-ae21-ac32bd8d7a17 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:00.807797 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2fe8c3d3-0d25-4985-ae21-ac32bd8d7a17 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:00.808547 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2fe8c3d3-0d25-4985-ae21-ac32bd8d7a17 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:00.809201 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2fe8c3d3-0d25-4985-ae21-ac32bd8d7a17 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:00.810118 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2fe8c3d3-0d25-4985-ae21-ac32bd8d7a17 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:00.810822 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2fe8c3d3-0d25-4985-ae21-ac32bd8d7a17 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:00.811415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2fe8c3d3-0d25-4985-ae21-ac32bd8d7a17 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:00.879222 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-dac64ac7-986b-4de7-8d2d-695696ed1fbf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Flavor limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:26:00.880789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-dac64ac7-986b-4de7-8d2d-695696ed1fbf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Image limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:26:00.882071 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-dac64ac7-986b-4de7-8d2d-695696ed1fbf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Flavor pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:26:00.883390 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-dac64ac7-986b-4de7-8d2d-695696ed1fbf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Image pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:26:00.884026 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-dac64ac7-986b-4de7-8d2d-695696ed1fbf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:26:00.894361 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dac64ac7-986b-4de7-8d2d-695696ed1fbf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:00.894930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dac64ac7-986b-4de7-8d2d-695696ed1fbf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:00.895611 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dac64ac7-986b-4de7-8d2d-695696ed1fbf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:00.896602 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dac64ac7-986b-4de7-8d2d-695696ed1fbf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:00.897408 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dac64ac7-986b-4de7-8d2d-695696ed1fbf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:00.899008 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dac64ac7-986b-4de7-8d2d-695696ed1fbf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:00.917208 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-dac64ac7-986b-4de7-8d2d-695696ed1fbf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Getting quotas for project 99c755c2cb864d05ac8561716aba8ae2. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:26:00.922357 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-dac64ac7-986b-4de7-8d2d-695696ed1fbf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Getting quotas for user 1c0ce4393b244819aa940ab5cd6b5812 and project 99c755c2cb864d05ac8561716aba8ae2. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:26:00.998687 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-2fe8c3d3-0d25-4985-ae21-ac32bd8d7a17 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:00.998884 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-dac64ac7-986b-4de7-8d2d-695696ed1fbf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Going to run 1 instances... {{(pid=120473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:26:01.001217 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-dac64ac7-986b-4de7-8d2d-695696ed1fbf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bce4c56f-0454-4d92-9b70-77be888dfade',volume_size=None,volume_type=None)] {{(pid=120473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:26:01.009983 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-2fe8c3d3-0d25-4985-ae21-ac32bd8d7a17 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1700 microversion: 2.1 time: 0.216182 Sep 20 22:26:01.010678 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 155/313] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:00 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1700 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:26:01.045315 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-2ee2a7e9-088f-4105-9c53-c1e4b6986a10 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:26:01.059086 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2ee2a7e9-088f-4105-9c53-c1e4b6986a10 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:01.059843 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2ee2a7e9-088f-4105-9c53-c1e4b6986a10 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:01.060536 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2ee2a7e9-088f-4105-9c53-c1e4b6986a10 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:01.104921 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-2ee2a7e9-088f-4105-9c53-c1e4b6986a10 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Going to try to start instance {{(pid=120474) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 20 22:26:01.186006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-2ee2a7e9-088f-4105-9c53-c1e4b6986a10 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "POST /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0/action" status: 202 len: 0 microversion: 2.1 time: 0.146186 Sep 20 22:26:01.190693 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 156/314] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 20 22:26:01 2022] POST /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:26:01.196324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4d590124-0540-432b-89c6-f7b3927ed7e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:01.197046 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4d590124-0540-432b-89c6-f7b3927ed7e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:01.204423 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4d590124-0540-432b-89c6-f7b3927ed7e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:01.205795 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4d590124-0540-432b-89c6-f7b3927ed7e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:01.206577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4d590124-0540-432b-89c6-f7b3927ed7e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:01.207495 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4d590124-0540-432b-89c6-f7b3927ed7e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:01.208306 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4d590124-0540-432b-89c6-f7b3927ed7e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:01.209088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4d590124-0540-432b-89c6-f7b3927ed7e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:01.298318 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-dac64ac7-986b-4de7-8d2d-695696ed1fbf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.062421 Sep 20 22:26:01.305555 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 159/315] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:26:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 22:26:01.319233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c8d7a816-be08-4183-8bbd-19d59ae514cc tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:01.319881 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c8d7a816-be08-4183-8bbd-19d59ae514cc tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:01.346668 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c8d7a816-be08-4183-8bbd-19d59ae514cc tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:01.347276 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c8d7a816-be08-4183-8bbd-19d59ae514cc tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:01.347725 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c8d7a816-be08-4183-8bbd-19d59ae514cc tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:01.369569 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c8d7a816-be08-4183-8bbd-19d59ae514cc tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:01.370167 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c8d7a816-be08-4183-8bbd-19d59ae514cc tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:01.370617 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c8d7a816-be08-4183-8bbd-19d59ae514cc tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:01.430720 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4d590124-0540-432b-89c6-f7b3927ed7e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:01.442455 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4d590124-0540-432b-89c6-f7b3927ed7e7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1709 microversion: 2.1 time: 0.250042 Sep 20 22:26:01.443675 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 157/316] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:01 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1709 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:01.449525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5ac003ec-8f90-4a05-bd61-11c3b22bafe8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:01.450233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5ac003ec-8f90-4a05-bd61-11c3b22bafe8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:01.524001 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-5ac003ec-8f90-4a05-bd61-11c3b22bafe8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:01.535882 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5ac003ec-8f90-4a05-bd61-11c3b22bafe8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1088 microversion: 2.1 time: 0.090997 Sep 20 22:26:01.537086 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 158/317] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:01 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1088 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:01.544074 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-577e2284-ed60-4d3c-ac32-58d839d433c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:01.545439 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-577e2284-ed60-4d3c-ac32-58d839d433c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:01.554648 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-577e2284-ed60-4d3c-ac32-58d839d433c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:01.556132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-577e2284-ed60-4d3c-ac32-58d839d433c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:01.556551 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-577e2284-ed60-4d3c-ac32-58d839d433c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:01.558153 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-577e2284-ed60-4d3c-ac32-58d839d433c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:01.558525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-577e2284-ed60-4d3c-ac32-58d839d433c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:01.559292 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-577e2284-ed60-4d3c-ac32-58d839d433c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:01.739370 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c8d7a816-be08-4183-8bbd-19d59ae514cc tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:01.753257 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-c8d7a816-be08-4183-8bbd-19d59ae514cc tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1500 microversion: 2.1 time: 0.451720 Sep 20 22:26:01.757914 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 160/318] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:01 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1500 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:01.782620 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-790b0c96-8fd4-41bc-90d1-04ffcb93bcdd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "331ed309-725f-4efe-ad80-52564af5381d"}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:26:01.790023 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-790b0c96-8fd4-41bc-90d1-04ffcb93bcdd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:01.798629 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-790b0c96-8fd4-41bc-90d1-04ffcb93bcdd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:01.799467 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-790b0c96-8fd4-41bc-90d1-04ffcb93bcdd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:01.800122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-790b0c96-8fd4-41bc-90d1-04ffcb93bcdd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:01.801289 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-790b0c96-8fd4-41bc-90d1-04ffcb93bcdd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:01.801957 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-790b0c96-8fd4-41bc-90d1-04ffcb93bcdd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:01.802636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-790b0c96-8fd4-41bc-90d1-04ffcb93bcdd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:01.827947 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-577e2284-ed60-4d3c-ac32-58d839d433c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:01.830924 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=100 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:01.837788 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-790b0c96-8fd4-41bc-90d1-04ffcb93bcdd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] HTTP exception thrown: Cannot 'attach_volume' instance 7b72562d-a97c-4822-bb23-f96a857ce91e while it is in vm_state rescued Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-790b0c96-8fd4-41bc-90d1-04ffcb93bcdd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Request method failure captured: Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: POST /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e/os-volume_attachments HTTP/1.1 Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 74 Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj121zgLwFJmRdY8P7mlmZ0v-f9HObvaDYJxym52l22Y024SfHGWFrqhydZ0ZORQZ7-32KLCyqBkv_IlwCXlVT0i8YM1I13VcrEKJTKuP6ul-aOq7DYohb9IE3g2mh3VHvoeTrM31ytaLizPn4LX9RAhk2JxUd9tYcXBoVxsD6N2zWY Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: e1076a54706448038779945f53703345 Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-475540964 Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:26:01.840743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:26:01.842074 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e1076a54706448038779945f53703345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e1076a54706448038779945f53703345", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e1076a54706448038779945f53703345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e1076a54706448038779945f53703345"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:26:01.842074 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-ServerRescueNegativeTestJSON-475540964 Sep 20 22:26:01.842074 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: e1076a54706448038779945f53703345 Sep 20 22:26:01.842074 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-475540964 Sep 20 22:26:01.842074 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-ServerRescueNegativeTestJSON-475540964-project Sep 20 22:26:01.842074 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:26:01.842074 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:26:01.842074 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 55ab0d396ace494c8884d21d41a04e72 Sep 20 22:26:01.842074 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-ServerRescueNegativeTestJSON-475540964-project Sep 20 22:26:01.842074 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Sep 20 22:26:01.842074 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {"volumeAttachment": {"volumeId": "331ed309-725f-4efe-ad80-52564af5381d"}} Sep 20 22:26:01.842074 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Cannot 'attach_volume' instance 7b72562d-a97c-4822-bb23-f96a857ce91e while it is in vm_state rescued Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'server_id': '7b72562d-a97c-4822-bb23-f96a857ce91e', 'body': {'volumeAttachment': {'volumeId': '331ed309-725f-4efe-ad80-52564af5381d'}}} Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b72562d-a97c-4822-bb23-f96a857ce91e in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:26:01.842833 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7b72562d-a97c-4822-bb23-f96a857ce91e while it is in vm_state rescued Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:26:01.843993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:26:01.845866 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:26:01.845866 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:26:01.845866 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7b72562d-a97c-4822-bb23-f96a857ce91e while it is in vm_state rescued Sep 20 22:26:01.845866 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:26:01.846416 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-577e2284-ed60-4d3c-ac32-58d839d433c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:01.847179 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-577e2284-ed60-4d3c-ac32-58d839d433c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:01.848080 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-790b0c96-8fd4-41bc-90d1-04ffcb93bcdd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Returning 409 to user: Cannot 'attach_volume' instance 7b72562d-a97c-4822-bb23-f96a857ce91e while it is in vm_state rescued {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:26:01.849528 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-790b0c96-8fd4-41bc-90d1-04ffcb93bcdd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "POST /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.072567 Sep 20 22:26:01.851319 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 161/319] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 20 22:26:01 2022] POST /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e/os-volume_attachments => generated 152 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 20 22:26:01.854813 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-577e2284-ed60-4d3c-ac32-58d839d433c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.314856 Sep 20 22:26:01.856510 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 159/320] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:01 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:01.861167 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-088b06ce-27dc-4acd-813e-15a9715eaf7e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:26:01.861765 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-088b06ce-27dc-4acd-813e-15a9715eaf7e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:01.871515 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-088b06ce-27dc-4acd-813e-15a9715eaf7e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:01.872439 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-088b06ce-27dc-4acd-813e-15a9715eaf7e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:01.873316 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-088b06ce-27dc-4acd-813e-15a9715eaf7e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:01.874456 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-088b06ce-27dc-4acd-813e-15a9715eaf7e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:01.881858 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-088b06ce-27dc-4acd-813e-15a9715eaf7e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:01.883157 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-088b06ce-27dc-4acd-813e-15a9715eaf7e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:02.001448 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-088b06ce-27dc-4acd-813e-15a9715eaf7e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "POST /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e/action" status: 202 len: 0 microversion: 2.1 time: 0.144589 Sep 20 22:26:02.006084 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 162/321] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 20 22:26:01 2022] POST /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:26:02.014668 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-39d82f32-106c-4443-8340-fb47dbbb41c9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:02.015268 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-39d82f32-106c-4443-8340-fb47dbbb41c9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:02.033001 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-39d82f32-106c-4443-8340-fb47dbbb41c9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:02.033543 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-39d82f32-106c-4443-8340-fb47dbbb41c9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:02.033987 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-39d82f32-106c-4443-8340-fb47dbbb41c9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:02.040179 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-39d82f32-106c-4443-8340-fb47dbbb41c9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:02.043927 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-39d82f32-106c-4443-8340-fb47dbbb41c9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:02.044581 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-39d82f32-106c-4443-8340-fb47dbbb41c9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:02.327932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-39d82f32-106c-4443-8340-fb47dbbb41c9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:02.346046 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-39d82f32-106c-4443-8340-fb47dbbb41c9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1508 microversion: 2.1 time: 0.337674 Sep 20 22:26:02.355820 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 160/322] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:02 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:02.469078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-94e5cecb-8977-424b-a4a8-86b11bba8110 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:02.470118 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-94e5cecb-8977-424b-a4a8-86b11bba8110 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:02.477707 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-94e5cecb-8977-424b-a4a8-86b11bba8110 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:02.478211 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-94e5cecb-8977-424b-a4a8-86b11bba8110 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:02.478913 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-94e5cecb-8977-424b-a4a8-86b11bba8110 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:02.479695 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-94e5cecb-8977-424b-a4a8-86b11bba8110 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:02.480154 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-94e5cecb-8977-424b-a4a8-86b11bba8110 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:02.480585 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-94e5cecb-8977-424b-a4a8-86b11bba8110 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:02.562754 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-7546b6a7-8f69-4f12-92e5-66513fd36fd4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:02.563923 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-7546b6a7-8f69-4f12-92e5-66513fd36fd4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:02.576319 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7546b6a7-8f69-4f12-92e5-66513fd36fd4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:02.577473 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7546b6a7-8f69-4f12-92e5-66513fd36fd4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:02.578207 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7546b6a7-8f69-4f12-92e5-66513fd36fd4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:02.579306 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7546b6a7-8f69-4f12-92e5-66513fd36fd4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:02.580030 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7546b6a7-8f69-4f12-92e5-66513fd36fd4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:02.580781 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7546b6a7-8f69-4f12-92e5-66513fd36fd4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:02.610445 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:02.703501 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-7546b6a7-8f69-4f12-92e5-66513fd36fd4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:02.712179 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-7546b6a7-8f69-4f12-92e5-66513fd36fd4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1186 microversion: 2.1 time: 0.153797 Sep 20 22:26:02.713074 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 161/323] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:02 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1186 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:26:02.715026 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-94e5cecb-8977-424b-a4a8-86b11bba8110 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:02.740411 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-94e5cecb-8977-424b-a4a8-86b11bba8110 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1709 microversion: 2.1 time: 0.276204 Sep 20 22:26:02.745007 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 163/324] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:02 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1709 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:02.884544 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ba1bb3e6-680a-454b-9840-467874ae6682 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:02.885276 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ba1bb3e6-680a-454b-9840-467874ae6682 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:02.893728 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ba1bb3e6-680a-454b-9840-467874ae6682 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:02.894235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ba1bb3e6-680a-454b-9840-467874ae6682 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:02.896566 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ba1bb3e6-680a-454b-9840-467874ae6682 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:02.900617 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ba1bb3e6-680a-454b-9840-467874ae6682 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:02.901142 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ba1bb3e6-680a-454b-9840-467874ae6682 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:02.901614 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ba1bb3e6-680a-454b-9840-467874ae6682 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:03.108346 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ba1bb3e6-680a-454b-9840-467874ae6682 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:03.122000 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ba1bb3e6-680a-454b-9840-467874ae6682 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:03.127399 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ba1bb3e6-680a-454b-9840-467874ae6682 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:03.128870 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ba1bb3e6-680a-454b-9840-467874ae6682 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.249279 Sep 20 22:26:03.132883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 162/325] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:02 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:03.380559 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-396f6d48-858c-4461-8af1-6e6aba14e1b6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:03.381193 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-396f6d48-858c-4461-8af1-6e6aba14e1b6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:03.387616 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-396f6d48-858c-4461-8af1-6e6aba14e1b6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:03.388095 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-396f6d48-858c-4461-8af1-6e6aba14e1b6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:03.388529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-396f6d48-858c-4461-8af1-6e6aba14e1b6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:03.389257 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-396f6d48-858c-4461-8af1-6e6aba14e1b6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:03.389732 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-396f6d48-858c-4461-8af1-6e6aba14e1b6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:03.390175 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-396f6d48-858c-4461-8af1-6e6aba14e1b6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:03.527548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-396f6d48-858c-4461-8af1-6e6aba14e1b6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:03.535583 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-396f6d48-858c-4461-8af1-6e6aba14e1b6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1508 microversion: 2.1 time: 0.166867 Sep 20 22:26:03.536130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 164/326] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:03 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:03.738996 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3b1796aa-0a15-42b9-9bb6-113551cda718 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:03.740279 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-3b1796aa-0a15-42b9-9bb6-113551cda718 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:03.746603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b1796aa-0a15-42b9-9bb6-113551cda718 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:03.747094 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b1796aa-0a15-42b9-9bb6-113551cda718 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:03.747628 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b1796aa-0a15-42b9-9bb6-113551cda718 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:03.748344 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b1796aa-0a15-42b9-9bb6-113551cda718 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:03.748823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b1796aa-0a15-42b9-9bb6-113551cda718 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:03.749271 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b1796aa-0a15-42b9-9bb6-113551cda718 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:03.767676 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-125f6b9a-4f97-4d0b-8b9c-9bf16006ef51 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:03.768280 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-125f6b9a-4f97-4d0b-8b9c-9bf16006ef51 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:03.775439 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-125f6b9a-4f97-4d0b-8b9c-9bf16006ef51 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:03.776117 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-125f6b9a-4f97-4d0b-8b9c-9bf16006ef51 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:03.776551 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-125f6b9a-4f97-4d0b-8b9c-9bf16006ef51 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:03.777273 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-125f6b9a-4f97-4d0b-8b9c-9bf16006ef51 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:03.777725 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-125f6b9a-4f97-4d0b-8b9c-9bf16006ef51 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:03.778144 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-125f6b9a-4f97-4d0b-8b9c-9bf16006ef51 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:03.812955 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3b1796aa-0a15-42b9-9bb6-113551cda718 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:03.821635 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-3b1796aa-0a15-42b9-9bb6-113551cda718 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1186 microversion: 2.1 time: 0.086440 Sep 20 22:26:03.822218 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 163/327] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:03 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:03.954235 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-125f6b9a-4f97-4d0b-8b9c-9bf16006ef51 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:03.965393 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-125f6b9a-4f97-4d0b-8b9c-9bf16006ef51 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1713 microversion: 2.1 time: 0.201448 Sep 20 22:26:03.965963 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 165/328] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:03 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1713 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:26:04.160200 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c880a67e-efa5-4a0e-ac57-befda1be722a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:04.161081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-c880a67e-efa5-4a0e-ac57-befda1be722a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:04.169412 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c880a67e-efa5-4a0e-ac57-befda1be722a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:04.169912 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c880a67e-efa5-4a0e-ac57-befda1be722a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:04.170467 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c880a67e-efa5-4a0e-ac57-befda1be722a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:04.171240 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c880a67e-efa5-4a0e-ac57-befda1be722a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:04.171796 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c880a67e-efa5-4a0e-ac57-befda1be722a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:04.172224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c880a67e-efa5-4a0e-ac57-befda1be722a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:04.315959 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-c880a67e-efa5-4a0e-ac57-befda1be722a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:04.324947 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-c880a67e-efa5-4a0e-ac57-befda1be722a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:04.326501 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-c880a67e-efa5-4a0e-ac57-befda1be722a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:04.327787 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c880a67e-efa5-4a0e-ac57-befda1be722a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.173255 Sep 20 22:26:04.328344 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 164/329] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:04 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:26:04.559882 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-57800c39-14b5-4951-b10f-8150093b806a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:04.560585 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-57800c39-14b5-4951-b10f-8150093b806a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:04.562702 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:04.568428 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-57800c39-14b5-4951-b10f-8150093b806a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:04.568921 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-57800c39-14b5-4951-b10f-8150093b806a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:04.569597 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-57800c39-14b5-4951-b10f-8150093b806a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:04.570969 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-57800c39-14b5-4951-b10f-8150093b806a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:04.571727 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-57800c39-14b5-4951-b10f-8150093b806a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:04.572188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-57800c39-14b5-4951-b10f-8150093b806a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:04.727765 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-57800c39-14b5-4951-b10f-8150093b806a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:04.736074 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-57800c39-14b5-4951-b10f-8150093b806a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1508 microversion: 2.1 time: 0.180395 Sep 20 22:26:04.736723 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 166/330] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:04 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:26:04.844921 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-248bbf28-88cd-4d40-ae33-46e95c34f86c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:04.845696 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-248bbf28-88cd-4d40-ae33-46e95c34f86c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:04.852278 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-248bbf28-88cd-4d40-ae33-46e95c34f86c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:04.852871 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-248bbf28-88cd-4d40-ae33-46e95c34f86c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:04.853401 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-248bbf28-88cd-4d40-ae33-46e95c34f86c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:04.854194 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-248bbf28-88cd-4d40-ae33-46e95c34f86c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:04.854733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-248bbf28-88cd-4d40-ae33-46e95c34f86c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:04.855163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-248bbf28-88cd-4d40-ae33-46e95c34f86c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:04.922853 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-248bbf28-88cd-4d40-ae33-46e95c34f86c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:04.931470 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-248bbf28-88cd-4d40-ae33-46e95c34f86c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1204 microversion: 2.1 time: 0.090364 Sep 20 22:26:04.932041 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 165/331] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:04 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1204 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:05.355904 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c1ecbdf7-e606-4b7c-b502-49b02c3769c3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:05.356606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c1ecbdf7-e606-4b7c-b502-49b02c3769c3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:05.364055 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c1ecbdf7-e606-4b7c-b502-49b02c3769c3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:05.364855 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c1ecbdf7-e606-4b7c-b502-49b02c3769c3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:05.365776 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c1ecbdf7-e606-4b7c-b502-49b02c3769c3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:05.366720 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c1ecbdf7-e606-4b7c-b502-49b02c3769c3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:05.368080 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c1ecbdf7-e606-4b7c-b502-49b02c3769c3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:05.368594 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c1ecbdf7-e606-4b7c-b502-49b02c3769c3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:05.521496 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c1ecbdf7-e606-4b7c-b502-49b02c3769c3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:05.530050 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c1ecbdf7-e606-4b7c-b502-49b02c3769c3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:05.531602 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c1ecbdf7-e606-4b7c-b502-49b02c3769c3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:05.542121 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-c1ecbdf7-e606-4b7c-b502-49b02c3769c3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.191213 Sep 20 22:26:05.551419 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 167/332] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:05 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:05.761078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f7a2f257-3f05-45d3-bf9c-1bf011118eb1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:05.761648 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-f7a2f257-3f05-45d3-bf9c-1bf011118eb1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:05.768153 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f7a2f257-3f05-45d3-bf9c-1bf011118eb1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:05.769536 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f7a2f257-3f05-45d3-bf9c-1bf011118eb1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:05.769536 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f7a2f257-3f05-45d3-bf9c-1bf011118eb1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:05.769959 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f7a2f257-3f05-45d3-bf9c-1bf011118eb1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:05.770594 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f7a2f257-3f05-45d3-bf9c-1bf011118eb1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:05.771010 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f7a2f257-3f05-45d3-bf9c-1bf011118eb1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:05.955806 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-4ffc9644-777b-4f85-b13a-fb6ace8f4f1d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:05.956414 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-4ffc9644-777b-4f85-b13a-fb6ace8f4f1d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:05.965007 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ffc9644-777b-4f85-b13a-fb6ace8f4f1d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:05.965582 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ffc9644-777b-4f85-b13a-fb6ace8f4f1d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:05.965932 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ffc9644-777b-4f85-b13a-fb6ace8f4f1d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:05.966686 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ffc9644-777b-4f85-b13a-fb6ace8f4f1d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:05.967144 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ffc9644-777b-4f85-b13a-fb6ace8f4f1d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:05.967565 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ffc9644-777b-4f85-b13a-fb6ace8f4f1d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:05.977994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-f7a2f257-3f05-45d3-bf9c-1bf011118eb1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:06.001873 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-f7a2f257-3f05-45d3-bf9c-1bf011118eb1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1508 microversion: 2.1 time: 0.243167 Sep 20 22:26:06.003686 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 166/333] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:05 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1508 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:06.265403 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-4ffc9644-777b-4f85-b13a-fb6ace8f4f1d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:06.274266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-4ffc9644-777b-4f85-b13a-fb6ace8f4f1d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1272 microversion: 2.1 time: 0.321726 Sep 20 22:26:06.274770 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 168/334] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:05 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1272 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:26:06.571118 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b8546636-613d-45ef-8446-68fef7904652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:06.571722 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b8546636-613d-45ef-8446-68fef7904652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:06.577972 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8546636-613d-45ef-8446-68fef7904652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:06.578458 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8546636-613d-45ef-8446-68fef7904652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:06.579680 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8546636-613d-45ef-8446-68fef7904652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:06.581450 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8546636-613d-45ef-8446-68fef7904652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:06.582111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8546636-613d-45ef-8446-68fef7904652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:06.582762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8546636-613d-45ef-8446-68fef7904652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:06.852721 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b8546636-613d-45ef-8446-68fef7904652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:06.861381 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b8546636-613d-45ef-8446-68fef7904652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:06.863241 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b8546636-613d-45ef-8446-68fef7904652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:06.864659 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b8546636-613d-45ef-8446-68fef7904652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.298653 Sep 20 22:26:06.881409 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 167/335] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:06 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:07.021666 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-2b9eed29-d671-4765-8ca3-758d77b37041 req-5c68b1b2-54da-4f53-a5b6-79910585f43f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a507bbd4-a0a2-4ca8-b04a-1511797060be", "tag": "87454e86-c277-4775-8223-737852068e10"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:26:07.033231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ba7dde8a-592a-4bc5-8ba6-981a4f6b6435 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:07.034727 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ba7dde8a-592a-4bc5-8ba6-981a4f6b6435 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:07.048050 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-2b9eed29-d671-4765-8ca3-758d77b37041 req-5c68b1b2-54da-4f53-a5b6-79910585f43f service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:07.048538 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-2b9eed29-d671-4765-8ca3-758d77b37041 req-5c68b1b2-54da-4f53-a5b6-79910585f43f service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:07.049465 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-2b9eed29-d671-4765-8ca3-758d77b37041 req-5c68b1b2-54da-4f53-a5b6-79910585f43f service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:07.050001 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ba7dde8a-592a-4bc5-8ba6-981a4f6b6435 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:07.050509 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ba7dde8a-592a-4bc5-8ba6-981a4f6b6435 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:07.051104 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ba7dde8a-592a-4bc5-8ba6-981a4f6b6435 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:07.054444 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ba7dde8a-592a-4bc5-8ba6-981a4f6b6435 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:07.056117 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ba7dde8a-592a-4bc5-8ba6-981a4f6b6435 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:07.056565 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ba7dde8a-592a-4bc5-8ba6-981a4f6b6435 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:07.065499 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-2b9eed29-d671-4765-8ca3-758d77b37041 req-5c68b1b2-54da-4f53-a5b6-79910585f43f service nova] Creating event network-changed:87454e86-c277-4775-8223-737852068e10 for instance a507bbd4-a0a2-4ca8-b04a-1511797060be on hv-cinder-85827 Sep 20 22:26:07.071469 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-2b9eed29-d671-4765-8ca3-758d77b37041 req-5c68b1b2-54da-4f53-a5b6-79910585f43f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053453 Sep 20 22:26:07.072757 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 169/336] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:26:07.298883 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-44651582-e851-43e4-b408-e06130c24edb tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:07.299843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-44651582-e851-43e4-b408-e06130c24edb tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:07.306518 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-44651582-e851-43e4-b408-e06130c24edb tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:07.307301 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-44651582-e851-43e4-b408-e06130c24edb tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:07.307803 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-44651582-e851-43e4-b408-e06130c24edb tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:07.308579 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-44651582-e851-43e4-b408-e06130c24edb tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:07.309132 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-44651582-e851-43e4-b408-e06130c24edb tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:07.309763 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-44651582-e851-43e4-b408-e06130c24edb tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:07.323170 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ba7dde8a-592a-4bc5-8ba6-981a4f6b6435 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:07.345842 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ba7dde8a-592a-4bc5-8ba6-981a4f6b6435 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1514 microversion: 2.1 time: 0.320941 Sep 20 22:26:07.360998 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 168/337] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:07 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1514 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:07.531201 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-44651582-e851-43e4-b408-e06130c24edb tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:07.543363 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-44651582-e851-43e4-b408-e06130c24edb tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1260 microversion: 2.1 time: 0.248644 Sep 20 22:26:07.552237 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 170/338] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:07 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:26:07.891964 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f6ff20ab-0199-4665-b528-acce38c34949 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:07.892648 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-f6ff20ab-0199-4665-b528-acce38c34949 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:07.901144 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f6ff20ab-0199-4665-b528-acce38c34949 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:07.901741 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f6ff20ab-0199-4665-b528-acce38c34949 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:07.902277 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f6ff20ab-0199-4665-b528-acce38c34949 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:07.903080 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f6ff20ab-0199-4665-b528-acce38c34949 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:07.903639 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f6ff20ab-0199-4665-b528-acce38c34949 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:07.904182 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f6ff20ab-0199-4665-b528-acce38c34949 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:08.397141 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-f6ff20ab-0199-4665-b528-acce38c34949 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:08.406492 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-f6ff20ab-0199-4665-b528-acce38c34949 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:08.407990 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-f6ff20ab-0199-4665-b528-acce38c34949 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:08.409373 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-f6ff20ab-0199-4665-b528-acce38c34949 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.521447 Sep 20 22:26:08.409936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 169/339] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:07 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:08.567040 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-933ecbb7-fdca-459a-a490-8ad925e859e2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:08.567604 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-933ecbb7-fdca-459a-a490-8ad925e859e2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:08.574675 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-933ecbb7-fdca-459a-a490-8ad925e859e2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:08.575414 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-933ecbb7-fdca-459a-a490-8ad925e859e2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:08.575841 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-933ecbb7-fdca-459a-a490-8ad925e859e2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:08.576744 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-933ecbb7-fdca-459a-a490-8ad925e859e2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:08.577495 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-933ecbb7-fdca-459a-a490-8ad925e859e2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:08.578095 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-933ecbb7-fdca-459a-a490-8ad925e859e2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:08.731249 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-933ecbb7-fdca-459a-a490-8ad925e859e2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:08.740079 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-933ecbb7-fdca-459a-a490-8ad925e859e2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1260 microversion: 2.1 time: 0.176939 Sep 20 22:26:08.741286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 171/340] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:08 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:08.855974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-e8a11e21-7668-48eb-a0f3-118abb07123a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Action: 'create', calling method: .version_select at 0x7f24f6c42940>, body: {"keypair": {"name": "tempest-keypair-951626438", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5sZsgNc+qj3+v3IGtf03uAzos2YFh5R1AoiAcllJE1Z7xwo6fUtSHlDnACp8jXYvbWQ8WBc3bzMDrZ0c7MS+8a1e9q3pJDYH7KJ1R6sdOPR40GVSZpF/5Pn2JU9VcS5Q=="}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:26:08.872882 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-e8a11e21-7668-48eb-a0f3-118abb07123a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Getting quotas for project e1076a54706448038779945f53703345. Resources: {'key_pairs'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:26:08.876904 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-e8a11e21-7668-48eb-a0f3-118abb07123a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Getting quotas for user 55ab0d396ace494c8884d21d41a04e72 and project e1076a54706448038779945f53703345. Resources: {'key_pairs'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:26:08.900176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-e8a11e21-7668-48eb-a0f3-118abb07123a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047847 Sep 20 22:26:08.900932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 170/341] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 20 22:26:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:26:09.435581 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-34a3ef2a-b32c-414f-b42b-908b14626739 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:09.436191 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-34a3ef2a-b32c-414f-b42b-908b14626739 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:09.442093 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-34a3ef2a-b32c-414f-b42b-908b14626739 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:09.442576 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-34a3ef2a-b32c-414f-b42b-908b14626739 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:09.443027 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-34a3ef2a-b32c-414f-b42b-908b14626739 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:09.443706 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-34a3ef2a-b32c-414f-b42b-908b14626739 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:09.444162 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-34a3ef2a-b32c-414f-b42b-908b14626739 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:09.444582 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-34a3ef2a-b32c-414f-b42b-908b14626739 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:09.643319 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-34a3ef2a-b32c-414f-b42b-908b14626739 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:09.658750 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-34a3ef2a-b32c-414f-b42b-908b14626739 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:09.658750 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-34a3ef2a-b32c-414f-b42b-908b14626739 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:09.658750 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-34a3ef2a-b32c-414f-b42b-908b14626739 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1744 microversion: 2.20 time: 0.224964 Sep 20 22:26:09.659149 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 172/342] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:09 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1744 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:09.764318 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ccf7c063-ef64-498f-95df-f13fa767449a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:09.764932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ccf7c063-ef64-498f-95df-f13fa767449a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:09.774830 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ccf7c063-ef64-498f-95df-f13fa767449a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:09.775319 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ccf7c063-ef64-498f-95df-f13fa767449a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:09.775748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ccf7c063-ef64-498f-95df-f13fa767449a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:09.776447 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ccf7c063-ef64-498f-95df-f13fa767449a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:09.777098 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ccf7c063-ef64-498f-95df-f13fa767449a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:09.777672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ccf7c063-ef64-498f-95df-f13fa767449a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:09.933094 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ccf7c063-ef64-498f-95df-f13fa767449a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:09.941876 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ccf7c063-ef64-498f-95df-f13fa767449a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1260 microversion: 2.1 time: 0.181506 Sep 20 22:26:09.942576 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 171/343] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:09 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:10.575669 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ec3cddc9-e8fb-4160-bbba-1a4272baba71 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1226994435", "imageRef": "a1be001e-c2e4-44b7-b0d2-af96de3855c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb96844d-680b-4102-a9cf-bec623bb10c8"}], "security_groups": [{"name": "tempest-securitygroup--1099973051"}], "key_name": "tempest-keypair-951626438", "user_data": "}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:26:10.684240 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-cac67f3d-18f0-4512-afaf-abb26ad942d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:10.685099 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-cac67f3d-18f0-4512-afaf-abb26ad942d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:10.691354 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cac67f3d-18f0-4512-afaf-abb26ad942d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:10.691877 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cac67f3d-18f0-4512-afaf-abb26ad942d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:10.692308 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cac67f3d-18f0-4512-afaf-abb26ad942d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:10.693134 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cac67f3d-18f0-4512-afaf-abb26ad942d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:10.693591 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cac67f3d-18f0-4512-afaf-abb26ad942d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:10.694015 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cac67f3d-18f0-4512-afaf-abb26ad942d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:10.829750 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-cac67f3d-18f0-4512-afaf-abb26ad942d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:10.838731 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-cac67f3d-18f0-4512-afaf-abb26ad942d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:10.840677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-cac67f3d-18f0-4512-afaf-abb26ad942d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:10.841897 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-cac67f3d-18f0-4512-afaf-abb26ad942d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1744 microversion: 2.20 time: 0.163356 Sep 20 22:26:10.842465 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 172/344] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:10 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:26:10.907622 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=2 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:10.930171 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=6 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:10.967799 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-fe7dc8af-2b17-4031-9587-13f77ba289be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:10.968402 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-fe7dc8af-2b17-4031-9587-13f77ba289be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:10.975457 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fe7dc8af-2b17-4031-9587-13f77ba289be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:10.975935 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fe7dc8af-2b17-4031-9587-13f77ba289be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:10.976416 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fe7dc8af-2b17-4031-9587-13f77ba289be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:10.977629 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fe7dc8af-2b17-4031-9587-13f77ba289be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:10.978078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fe7dc8af-2b17-4031-9587-13f77ba289be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:10.978495 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fe7dc8af-2b17-4031-9587-13f77ba289be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:11.110672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-fe7dc8af-2b17-4031-9587-13f77ba289be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:11.118631 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-fe7dc8af-2b17-4031-9587-13f77ba289be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1260 microversion: 2.1 time: 0.156474 Sep 20 22:26:11.119130 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 173/345] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:10 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:26:11.868477 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ff5ea6ea-acf7-4a1f-bb10-0f4274061079 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:11.869092 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ff5ea6ea-acf7-4a1f-bb10-0f4274061079 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:11.875037 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ff5ea6ea-acf7-4a1f-bb10-0f4274061079 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:11.875631 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ff5ea6ea-acf7-4a1f-bb10-0f4274061079 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:11.875933 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ff5ea6ea-acf7-4a1f-bb10-0f4274061079 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:11.876609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ff5ea6ea-acf7-4a1f-bb10-0f4274061079 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:11.877092 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ff5ea6ea-acf7-4a1f-bb10-0f4274061079 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:11.877509 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ff5ea6ea-acf7-4a1f-bb10-0f4274061079 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:12.027171 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ff5ea6ea-acf7-4a1f-bb10-0f4274061079 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:12.038319 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ff5ea6ea-acf7-4a1f-bb10-0f4274061079 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:12.040755 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ff5ea6ea-acf7-4a1f-bb10-0f4274061079 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:12.042225 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ff5ea6ea-acf7-4a1f-bb10-0f4274061079 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1744 microversion: 2.20 time: 0.178481 Sep 20 22:26:12.042905 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 174/346] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:11 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1744 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:26:12.141909 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-778d1824-0a06-46da-a435-0329bd150355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:12.142519 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-778d1824-0a06-46da-a435-0329bd150355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:12.150668 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-778d1824-0a06-46da-a435-0329bd150355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:12.151183 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-778d1824-0a06-46da-a435-0329bd150355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:12.151599 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-778d1824-0a06-46da-a435-0329bd150355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:12.152477 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-778d1824-0a06-46da-a435-0329bd150355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:12.153382 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-778d1824-0a06-46da-a435-0329bd150355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:12.153544 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-778d1824-0a06-46da-a435-0329bd150355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:12.318232 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-778d1824-0a06-46da-a435-0329bd150355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:12.330982 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-778d1824-0a06-46da-a435-0329bd150355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1260 microversion: 2.1 time: 0.192804 Sep 20 22:26:12.331778 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 175/347] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:12 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:13.073800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-6489f2d5-34f4-4064-bc73-99c65ad3728c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:13.074481 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-6489f2d5-34f4-4064-bc73-99c65ad3728c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:13.080410 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6489f2d5-34f4-4064-bc73-99c65ad3728c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:13.080891 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6489f2d5-34f4-4064-bc73-99c65ad3728c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:13.081355 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6489f2d5-34f4-4064-bc73-99c65ad3728c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:13.082041 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6489f2d5-34f4-4064-bc73-99c65ad3728c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:13.082495 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6489f2d5-34f4-4064-bc73-99c65ad3728c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:13.082919 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6489f2d5-34f4-4064-bc73-99c65ad3728c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:13.214667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6489f2d5-34f4-4064-bc73-99c65ad3728c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:13.222775 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6489f2d5-34f4-4064-bc73-99c65ad3728c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:13.224212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6489f2d5-34f4-4064-bc73-99c65ad3728c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:13.225383 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-6489f2d5-34f4-4064-bc73-99c65ad3728c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1739 microversion: 2.20 time: 0.155666 Sep 20 22:26:13.225936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 176/348] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:13 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:26:13.355350 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-573c7cb1-0870-405b-b5e5-b6bccf35dea8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:13.355864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-573c7cb1-0870-405b-b5e5-b6bccf35dea8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:13.361936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-573c7cb1-0870-405b-b5e5-b6bccf35dea8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:13.362416 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-573c7cb1-0870-405b-b5e5-b6bccf35dea8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:13.362874 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-573c7cb1-0870-405b-b5e5-b6bccf35dea8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:13.363553 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-573c7cb1-0870-405b-b5e5-b6bccf35dea8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:13.363999 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-573c7cb1-0870-405b-b5e5-b6bccf35dea8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:13.364411 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-573c7cb1-0870-405b-b5e5-b6bccf35dea8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:13.501444 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-573c7cb1-0870-405b-b5e5-b6bccf35dea8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:13.509671 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-573c7cb1-0870-405b-b5e5-b6bccf35dea8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1260 microversion: 2.1 time: 0.158868 Sep 20 22:26:13.510226 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 177/349] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:13 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:26:14.064261 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-cbf95af7-0ba2-4bba-b390-947167dc8943 req-7b7819bb-54c5-4e02-a2c5-4bb9bbef8fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d58779-65b7-4b97-8536-eef4357a475d", "name": "network-vif-plugged", "status": "completed", "tag": "d965769d-834a-4b9f-817a-24e086032c2d"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:26:14.074974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-cbf95af7-0ba2-4bba-b390-947167dc8943 req-7b7819bb-54c5-4e02-a2c5-4bb9bbef8fa7 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:14.076225 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-cbf95af7-0ba2-4bba-b390-947167dc8943 req-7b7819bb-54c5-4e02-a2c5-4bb9bbef8fa7 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:14.076717 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-cbf95af7-0ba2-4bba-b390-947167dc8943 req-7b7819bb-54c5-4e02-a2c5-4bb9bbef8fa7 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:14.100403 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-cbf95af7-0ba2-4bba-b390-947167dc8943 req-7b7819bb-54c5-4e02-a2c5-4bb9bbef8fa7 service nova] Creating event network-vif-plugged:d965769d-834a-4b9f-817a-24e086032c2d for instance 48d58779-65b7-4b97-8536-eef4357a475d on hv-cinder-85827 Sep 20 22:26:14.105866 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-cbf95af7-0ba2-4bba-b390-947167dc8943 req-7b7819bb-54c5-4e02-a2c5-4bb9bbef8fa7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045195 Sep 20 22:26:14.106645 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 178/350] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:26:14.253841 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ee89ff84-47be-47ba-8443-54e3dab0ed2f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:14.254443 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ee89ff84-47be-47ba-8443-54e3dab0ed2f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:14.261026 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ee89ff84-47be-47ba-8443-54e3dab0ed2f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:14.261509 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ee89ff84-47be-47ba-8443-54e3dab0ed2f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:14.261940 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ee89ff84-47be-47ba-8443-54e3dab0ed2f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:14.262615 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ee89ff84-47be-47ba-8443-54e3dab0ed2f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:14.263060 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ee89ff84-47be-47ba-8443-54e3dab0ed2f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:14.263474 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ee89ff84-47be-47ba-8443-54e3dab0ed2f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:14.393343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ee89ff84-47be-47ba-8443-54e3dab0ed2f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:14.396839 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=100 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:14.403325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ee89ff84-47be-47ba-8443-54e3dab0ed2f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:14.404754 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ee89ff84-47be-47ba-8443-54e3dab0ed2f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:14.405956 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ee89ff84-47be-47ba-8443-54e3dab0ed2f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1739 microversion: 2.20 time: 0.156677 Sep 20 22:26:14.406508 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 179/351] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:14 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:26:14.531918 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5b327491-4698-4fa9-ab03-6c53a5fb5f34 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:14.532552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5b327491-4698-4fa9-ab03-6c53a5fb5f34 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:14.538483 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5b327491-4698-4fa9-ab03-6c53a5fb5f34 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:14.538981 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5b327491-4698-4fa9-ab03-6c53a5fb5f34 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:14.539405 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5b327491-4698-4fa9-ab03-6c53a5fb5f34 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:14.540082 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5b327491-4698-4fa9-ab03-6c53a5fb5f34 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:14.540526 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5b327491-4698-4fa9-ab03-6c53a5fb5f34 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:14.541104 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5b327491-4698-4fa9-ab03-6c53a5fb5f34 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:14.674574 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-5b327491-4698-4fa9-ab03-6c53a5fb5f34 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:14.682841 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5b327491-4698-4fa9-ab03-6c53a5fb5f34 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1260 microversion: 2.1 time: 0.154774 Sep 20 22:26:14.683406 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 180/352] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:14 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:26:15.430376 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-358584e4-9122-4c33-ba5e-5acf57db6599 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:15.431089 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-358584e4-9122-4c33-ba5e-5acf57db6599 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:15.437567 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-358584e4-9122-4c33-ba5e-5acf57db6599 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:15.438048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-358584e4-9122-4c33-ba5e-5acf57db6599 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:15.438509 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-358584e4-9122-4c33-ba5e-5acf57db6599 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:15.439190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-358584e4-9122-4c33-ba5e-5acf57db6599 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:15.439635 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-358584e4-9122-4c33-ba5e-5acf57db6599 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:15.440052 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-358584e4-9122-4c33-ba5e-5acf57db6599 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:15.573679 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-358584e4-9122-4c33-ba5e-5acf57db6599 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:15.581859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-358584e4-9122-4c33-ba5e-5acf57db6599 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:15.583328 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-358584e4-9122-4c33-ba5e-5acf57db6599 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:15.584485 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-358584e4-9122-4c33-ba5e-5acf57db6599 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1739 microversion: 2.20 time: 0.158084 Sep 20 22:26:15.585074 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 181/353] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:15 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:26:15.705979 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a0ef25a6-4b80-48bd-8c2e-269c0cb27bfc tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:15.706589 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a0ef25a6-4b80-48bd-8c2e-269c0cb27bfc tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:15.713154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a0ef25a6-4b80-48bd-8c2e-269c0cb27bfc tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:15.713991 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a0ef25a6-4b80-48bd-8c2e-269c0cb27bfc tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:15.717605 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a0ef25a6-4b80-48bd-8c2e-269c0cb27bfc tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:15.717605 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a0ef25a6-4b80-48bd-8c2e-269c0cb27bfc tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:15.717605 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a0ef25a6-4b80-48bd-8c2e-269c0cb27bfc tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:15.717605 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a0ef25a6-4b80-48bd-8c2e-269c0cb27bfc tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:15.854993 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a0ef25a6-4b80-48bd-8c2e-269c0cb27bfc tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:15.862740 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a0ef25a6-4b80-48bd-8c2e-269c0cb27bfc tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1260 microversion: 2.1 time: 0.160794 Sep 20 22:26:15.863314 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 182/354] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:15 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:16.613420 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9ad3bc42-b40a-4774-be0b-63d254fc74de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:16.614476 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9ad3bc42-b40a-4774-be0b-63d254fc74de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:16.621845 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9ad3bc42-b40a-4774-be0b-63d254fc74de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:16.622429 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9ad3bc42-b40a-4774-be0b-63d254fc74de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:16.622862 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9ad3bc42-b40a-4774-be0b-63d254fc74de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:16.623563 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9ad3bc42-b40a-4774-be0b-63d254fc74de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:16.624008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9ad3bc42-b40a-4774-be0b-63d254fc74de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:16.624783 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9ad3bc42-b40a-4774-be0b-63d254fc74de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:16.767921 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-9ad3bc42-b40a-4774-be0b-63d254fc74de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:16.776639 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-9ad3bc42-b40a-4774-be0b-63d254fc74de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:16.778185 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-9ad3bc42-b40a-4774-be0b-63d254fc74de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:16.779300 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-9ad3bc42-b40a-4774-be0b-63d254fc74de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1739 microversion: 2.20 time: 0.171600 Sep 20 22:26:16.779858 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 183/355] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:16 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:26:16.885643 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-43aac8cd-f1ed-414c-9e7a-6a85b69dec50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:16.886246 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-43aac8cd-f1ed-414c-9e7a-6a85b69dec50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:16.892364 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-43aac8cd-f1ed-414c-9e7a-6a85b69dec50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:16.897598 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-43aac8cd-f1ed-414c-9e7a-6a85b69dec50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:16.897598 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-43aac8cd-f1ed-414c-9e7a-6a85b69dec50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:16.897598 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-43aac8cd-f1ed-414c-9e7a-6a85b69dec50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:16.897598 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-43aac8cd-f1ed-414c-9e7a-6a85b69dec50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:16.900541 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-43aac8cd-f1ed-414c-9e7a-6a85b69dec50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:17.030523 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-43aac8cd-f1ed-414c-9e7a-6a85b69dec50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:17.038225 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-43aac8cd-f1ed-414c-9e7a-6a85b69dec50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1260 microversion: 2.1 time: 0.157033 Sep 20 22:26:17.038789 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 184/356] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:16 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:26:17.803737 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-dcbe7ad7-dbdd-4e52-aeb8-8a2e371da3a0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:17.804401 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-dcbe7ad7-dbdd-4e52-aeb8-8a2e371da3a0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:17.810694 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dcbe7ad7-dbdd-4e52-aeb8-8a2e371da3a0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:17.811163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dcbe7ad7-dbdd-4e52-aeb8-8a2e371da3a0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:17.811604 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dcbe7ad7-dbdd-4e52-aeb8-8a2e371da3a0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:17.812258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dcbe7ad7-dbdd-4e52-aeb8-8a2e371da3a0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:17.812704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dcbe7ad7-dbdd-4e52-aeb8-8a2e371da3a0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:17.813153 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dcbe7ad7-dbdd-4e52-aeb8-8a2e371da3a0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:17.965608 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-dcbe7ad7-dbdd-4e52-aeb8-8a2e371da3a0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:17.973890 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-dcbe7ad7-dbdd-4e52-aeb8-8a2e371da3a0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:17.975350 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-dcbe7ad7-dbdd-4e52-aeb8-8a2e371da3a0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:17.977137 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-dcbe7ad7-dbdd-4e52-aeb8-8a2e371da3a0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1739 microversion: 2.20 time: 0.177299 Sep 20 22:26:17.977735 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 185/357] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:17 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:26:18.064417 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-53d56f85-735c-4a8a-baeb-6e3e676a341c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:18.065051 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-53d56f85-735c-4a8a-baeb-6e3e676a341c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:18.071415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-53d56f85-735c-4a8a-baeb-6e3e676a341c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:18.071896 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-53d56f85-735c-4a8a-baeb-6e3e676a341c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:18.072332 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-53d56f85-735c-4a8a-baeb-6e3e676a341c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:18.073041 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-53d56f85-735c-4a8a-baeb-6e3e676a341c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:18.073502 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-53d56f85-735c-4a8a-baeb-6e3e676a341c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:18.074021 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-53d56f85-735c-4a8a-baeb-6e3e676a341c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:18.222081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-53d56f85-735c-4a8a-baeb-6e3e676a341c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:18.230842 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-53d56f85-735c-4a8a-baeb-6e3e676a341c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1260 microversion: 2.1 time: 0.170233 Sep 20 22:26:18.232330 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 186/358] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:18 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:26:18.244263 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-095cc4a2-9fa0-4f70-883e-f1f387e0ac45 req-dc34be63-f7f4-4d4a-b7fa-6a74b66b7e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a507bbd4-a0a2-4ca8-b04a-1511797060be", "name": "network-vif-plugged", "status": "completed", "tag": "87454e86-c277-4775-8223-737852068e10"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:26:18.255992 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-095cc4a2-9fa0-4f70-883e-f1f387e0ac45 req-dc34be63-f7f4-4d4a-b7fa-6a74b66b7e7f service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:18.256907 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-095cc4a2-9fa0-4f70-883e-f1f387e0ac45 req-dc34be63-f7f4-4d4a-b7fa-6a74b66b7e7f service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:18.257372 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-095cc4a2-9fa0-4f70-883e-f1f387e0ac45 req-dc34be63-f7f4-4d4a-b7fa-6a74b66b7e7f service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:18.269209 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-095cc4a2-9fa0-4f70-883e-f1f387e0ac45 req-dc34be63-f7f4-4d4a-b7fa-6a74b66b7e7f service nova] Creating event network-vif-plugged:87454e86-c277-4775-8223-737852068e10 for instance a507bbd4-a0a2-4ca8-b04a-1511797060be on hv-cinder-85827 Sep 20 22:26:18.274694 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-095cc4a2-9fa0-4f70-883e-f1f387e0ac45 req-dc34be63-f7f4-4d4a-b7fa-6a74b66b7e7f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035131 Sep 20 22:26:18.275563 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 187/359] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:26:19.004873 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-010d0388-be09-4f36-89ca-890d85d34e52 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:19.005600 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-010d0388-be09-4f36-89ca-890d85d34e52 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:19.008493 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=6 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:19.010421 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:19.014193 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-010d0388-be09-4f36-89ca-890d85d34e52 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:19.014695 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-010d0388-be09-4f36-89ca-890d85d34e52 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:19.015130 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-010d0388-be09-4f36-89ca-890d85d34e52 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:19.015854 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-010d0388-be09-4f36-89ca-890d85d34e52 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:19.016309 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-010d0388-be09-4f36-89ca-890d85d34e52 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:19.016735 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-010d0388-be09-4f36-89ca-890d85d34e52 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:19.132123 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.network.neutron [None req-ec3cddc9-e8fb-4160-bbba-1a4272baba71 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] validate_networks() for [('fb96844d-680b-4102-a9cf-bec623bb10c8', None, None, None, None, None)] {{(pid=120473) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:26:19.161895 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-010d0388-be09-4f36-89ca-890d85d34e52 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:19.170338 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-010d0388-be09-4f36-89ca-890d85d34e52 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:19.171789 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-010d0388-be09-4f36-89ca-890d85d34e52 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:19.172950 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-010d0388-be09-4f36-89ca-890d85d34e52 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1739 microversion: 2.20 time: 0.172412 Sep 20 22:26:19.173528 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 188/360] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:18 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:26:19.256281 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-de5ef9e3-2df3-4e10-b634-0263928ec754 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:19.257055 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-de5ef9e3-2df3-4e10-b634-0263928ec754 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:19.263692 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-de5ef9e3-2df3-4e10-b634-0263928ec754 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:19.264249 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-de5ef9e3-2df3-4e10-b634-0263928ec754 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:19.264786 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-de5ef9e3-2df3-4e10-b634-0263928ec754 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:19.265571 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-de5ef9e3-2df3-4e10-b634-0263928ec754 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:19.266095 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-de5ef9e3-2df3-4e10-b634-0263928ec754 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:19.266582 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-de5ef9e3-2df3-4e10-b634-0263928ec754 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:19.401377 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-de5ef9e3-2df3-4e10-b634-0263928ec754 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:19.409614 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-de5ef9e3-2df3-4e10-b634-0263928ec754 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1260 microversion: 2.1 time: 0.157096 Sep 20 22:26:19.410189 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 189/361] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:19 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:26:19.525265 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-ec3cddc9-e8fb-4160-bbba-1a4272baba71 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Flavor limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:26:19.525791 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-ec3cddc9-e8fb-4160-bbba-1a4272baba71 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Image limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:26:19.526370 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-ec3cddc9-e8fb-4160-bbba-1a4272baba71 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Flavor pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:26:19.526936 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-ec3cddc9-e8fb-4160-bbba-1a4272baba71 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Image pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:26:19.527415 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-ec3cddc9-e8fb-4160-bbba-1a4272baba71 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:26:19.536318 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ec3cddc9-e8fb-4160-bbba-1a4272baba71 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:19.536883 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ec3cddc9-e8fb-4160-bbba-1a4272baba71 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:19.537405 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ec3cddc9-e8fb-4160-bbba-1a4272baba71 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:19.538210 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ec3cddc9-e8fb-4160-bbba-1a4272baba71 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:19.539247 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ec3cddc9-e8fb-4160-bbba-1a4272baba71 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:19.539733 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ec3cddc9-e8fb-4160-bbba-1a4272baba71 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:19.557981 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-ec3cddc9-e8fb-4160-bbba-1a4272baba71 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Getting quotas for project e1076a54706448038779945f53703345. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:26:19.561982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-ec3cddc9-e8fb-4160-bbba-1a4272baba71 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Getting quotas for user 55ab0d396ace494c8884d21d41a04e72 and project e1076a54706448038779945f53703345. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:26:19.572607 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ec3cddc9-e8fb-4160-bbba-1a4272baba71 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Going to run 1 instances... {{(pid=120473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:26:19.574977 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ec3cddc9-e8fb-4160-bbba-1a4272baba71 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a1be001e-c2e4-44b7-b0d2-af96de3855c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:26:19.625027 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ec3cddc9-e8fb-4160-bbba-1a4272baba71 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 9.053562 Sep 20 22:26:19.625850 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 173/362] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:26:10 2022] POST /compute/v2.1/servers => generated 409 bytes in 9055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 22:26:19.637167 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-07ed2004-d423-4bce-8717-2490a2469c79 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:19.637685 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-07ed2004-d423-4bce-8717-2490a2469c79 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:19.697513 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-07ed2004-d423-4bce-8717-2490a2469c79 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:19.704821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-07ed2004-d423-4bce-8717-2490a2469c79 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1245 microversion: 2.1 time: 0.071573 Sep 20 22:26:19.706662 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 190/363] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:19 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1245 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:20.201021 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b3be630a-28f1-4e29-8312-07839abcecfd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:20.204109 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b3be630a-28f1-4e29-8312-07839abcecfd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:20.213374 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b3be630a-28f1-4e29-8312-07839abcecfd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:20.214226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b3be630a-28f1-4e29-8312-07839abcecfd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:20.214680 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b3be630a-28f1-4e29-8312-07839abcecfd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:20.215517 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b3be630a-28f1-4e29-8312-07839abcecfd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:20.215978 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b3be630a-28f1-4e29-8312-07839abcecfd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:20.216434 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b3be630a-28f1-4e29-8312-07839abcecfd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:20.410863 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b3be630a-28f1-4e29-8312-07839abcecfd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:20.421558 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b3be630a-28f1-4e29-8312-07839abcecfd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:20.429175 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b3be630a-28f1-4e29-8312-07839abcecfd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:20.430664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b3be630a-28f1-4e29-8312-07839abcecfd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1739 microversion: 2.20 time: 0.234643 Sep 20 22:26:20.432331 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-72bc5341-175e-439b-8612-ca4421314663 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:20.433484 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-72bc5341-175e-439b-8612-ca4421314663 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:20.441957 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-72bc5341-175e-439b-8612-ca4421314663 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:20.444539 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-72bc5341-175e-439b-8612-ca4421314663 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:20.447941 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-72bc5341-175e-439b-8612-ca4421314663 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:20.449161 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-72bc5341-175e-439b-8612-ca4421314663 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:20.449788 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-72bc5341-175e-439b-8612-ca4421314663 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:20.451148 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 174/364] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:20 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:20.453252 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-72bc5341-175e-439b-8612-ca4421314663 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:20.671837 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-72bc5341-175e-439b-8612-ca4421314663 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:20.681425 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-72bc5341-175e-439b-8612-ca4421314663 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1260 microversion: 2.1 time: 0.253074 Sep 20 22:26:20.682488 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 191/365] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:20 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1260 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:20.733070 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-623d478d-7253-483a-9cb3-f0b0c2580f1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:20.733995 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-623d478d-7253-483a-9cb3-f0b0c2580f1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:20.742957 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-623d478d-7253-483a-9cb3-f0b0c2580f1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:20.743749 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-623d478d-7253-483a-9cb3-f0b0c2580f1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:20.744397 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-623d478d-7253-483a-9cb3-f0b0c2580f1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:20.745507 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-623d478d-7253-483a-9cb3-f0b0c2580f1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:20.746158 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-623d478d-7253-483a-9cb3-f0b0c2580f1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:20.746737 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-623d478d-7253-483a-9cb3-f0b0c2580f1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:20.827666 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-623d478d-7253-483a-9cb3-f0b0c2580f1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:20.838436 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-623d478d-7253-483a-9cb3-f0b0c2580f1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1241 microversion: 2.1 time: 0.109617 Sep 20 22:26:20.852998 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 175/366] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:20 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:21.457898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-854cf8c9-df64-4189-8cf4-480be89b21ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:21.459086 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-854cf8c9-df64-4189-8cf4-480be89b21ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:21.467007 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-854cf8c9-df64-4189-8cf4-480be89b21ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:21.467777 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-854cf8c9-df64-4189-8cf4-480be89b21ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:21.468237 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-854cf8c9-df64-4189-8cf4-480be89b21ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:21.468957 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-854cf8c9-df64-4189-8cf4-480be89b21ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:21.469678 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-854cf8c9-df64-4189-8cf4-480be89b21ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:21.470437 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-854cf8c9-df64-4189-8cf4-480be89b21ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:21.713724 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-cebdfc4b-ad71-40ef-919b-8dfbde2449d3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:21.714322 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-cebdfc4b-ad71-40ef-919b-8dfbde2449d3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:21.734260 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cebdfc4b-ad71-40ef-919b-8dfbde2449d3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:21.734969 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cebdfc4b-ad71-40ef-919b-8dfbde2449d3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:21.735586 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cebdfc4b-ad71-40ef-919b-8dfbde2449d3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:21.736471 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cebdfc4b-ad71-40ef-919b-8dfbde2449d3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:21.737173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cebdfc4b-ad71-40ef-919b-8dfbde2449d3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:21.737756 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cebdfc4b-ad71-40ef-919b-8dfbde2449d3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:21.891565 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-854cf8c9-df64-4189-8cf4-480be89b21ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:21.909948 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-854cf8c9-df64-4189-8cf4-480be89b21ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:21.914126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-854cf8c9-df64-4189-8cf4-480be89b21ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:21.919804 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-854cf8c9-df64-4189-8cf4-480be89b21ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1739 microversion: 2.20 time: 0.465973 Sep 20 22:26:21.920768 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 192/367] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:21 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1739 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:21.933954 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-e310dccb-3108-4d9a-bfdb-cee342fd7be8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:21.934959 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-e310dccb-3108-4d9a-bfdb-cee342fd7be8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:21.948837 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e310dccb-3108-4d9a-bfdb-cee342fd7be8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:21.954307 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e310dccb-3108-4d9a-bfdb-cee342fd7be8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:21.955079 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e310dccb-3108-4d9a-bfdb-cee342fd7be8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:21.956031 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e310dccb-3108-4d9a-bfdb-cee342fd7be8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:21.956675 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e310dccb-3108-4d9a-bfdb-cee342fd7be8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:21.961361 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e310dccb-3108-4d9a-bfdb-cee342fd7be8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:21.978505 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-cebdfc4b-ad71-40ef-919b-8dfbde2449d3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:21.997399 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-cebdfc4b-ad71-40ef-919b-8dfbde2449d3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1444 microversion: 2.1 time: 0.288232 Sep 20 22:26:21.999055 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 176/368] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:21 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1444 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:22.037099 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-be8213da-414e-4808-9746-e135f837c6e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:22.037733 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-be8213da-414e-4808-9746-e135f837c6e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:22.052324 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-be8213da-414e-4808-9746-e135f837c6e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:22.052876 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-be8213da-414e-4808-9746-e135f837c6e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:22.053442 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-be8213da-414e-4808-9746-e135f837c6e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:22.054295 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-be8213da-414e-4808-9746-e135f837c6e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:22.054794 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-be8213da-414e-4808-9746-e135f837c6e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:22.055267 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-be8213da-414e-4808-9746-e135f837c6e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:22.082921 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-e310dccb-3108-4d9a-bfdb-cee342fd7be8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:22.096734 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-e310dccb-3108-4d9a-bfdb-cee342fd7be8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1315 microversion: 2.1 time: 0.167156 Sep 20 22:26:22.112669 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 193/369] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:21 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:22.278294 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-be8213da-414e-4808-9746-e135f837c6e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:22.289192 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-be8213da-414e-4808-9746-e135f837c6e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1444 microversion: 2.1 time: 0.256594 Sep 20 22:26:22.292515 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 177/370] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:22 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1444 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:26:22.969439 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-0247be1c-bb8f-4db2-a600-a1360aecb404 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:22.971581 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-0247be1c-bb8f-4db2-a600-a1360aecb404 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:22.985262 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0247be1c-bb8f-4db2-a600-a1360aecb404 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:22.987048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0247be1c-bb8f-4db2-a600-a1360aecb404 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:22.987705 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0247be1c-bb8f-4db2-a600-a1360aecb404 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:22.988735 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0247be1c-bb8f-4db2-a600-a1360aecb404 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:22.989411 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0247be1c-bb8f-4db2-a600-a1360aecb404 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:22.990340 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0247be1c-bb8f-4db2-a600-a1360aecb404 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:23.128403 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-861f1a46-adf5-440d-b2f9-c9b98196ce69 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:23.129685 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-861f1a46-adf5-440d-b2f9-c9b98196ce69 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:23.138140 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-861f1a46-adf5-440d-b2f9-c9b98196ce69 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:23.139222 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-861f1a46-adf5-440d-b2f9-c9b98196ce69 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:23.139743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-861f1a46-adf5-440d-b2f9-c9b98196ce69 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:23.140553 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-861f1a46-adf5-440d-b2f9-c9b98196ce69 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:23.141031 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-861f1a46-adf5-440d-b2f9-c9b98196ce69 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:23.141462 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-861f1a46-adf5-440d-b2f9-c9b98196ce69 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:23.167830 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:23.285825 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-0247be1c-bb8f-4db2-a600-a1360aecb404 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:23.300511 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-0247be1c-bb8f-4db2-a600-a1360aecb404 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:23.301990 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-0247be1c-bb8f-4db2-a600-a1360aecb404 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:23.303165 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-0247be1c-bb8f-4db2-a600-a1360aecb404 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1739 microversion: 2.20 time: 0.349673 Sep 20 22:26:23.304146 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 194/371] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:22 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1739 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:26:23.417413 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-861f1a46-adf5-440d-b2f9-c9b98196ce69 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:23.427887 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-861f1a46-adf5-440d-b2f9-c9b98196ce69 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1371 microversion: 2.1 time: 0.303224 Sep 20 22:26:23.449289 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 178/372] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:23 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1371 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:24.242481 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-9d035478-3ac7-45bb-a6d8-a3f1187f2747 req-091f6bc5-3724-4fe8-82c0-2aa714337fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704f353f-861e-47cf-9625-7210f9f1f81e", "tag": "514d6b9b-bb67-4159-8746-002d9cc07694"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:26:24.255620 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-9d035478-3ac7-45bb-a6d8-a3f1187f2747 req-091f6bc5-3724-4fe8-82c0-2aa714337fe2 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:24.259190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-9d035478-3ac7-45bb-a6d8-a3f1187f2747 req-091f6bc5-3724-4fe8-82c0-2aa714337fe2 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:24.259638 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-9d035478-3ac7-45bb-a6d8-a3f1187f2747 req-091f6bc5-3724-4fe8-82c0-2aa714337fe2 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:24.286656 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-9d035478-3ac7-45bb-a6d8-a3f1187f2747 req-091f6bc5-3724-4fe8-82c0-2aa714337fe2 service nova] Creating event network-changed:514d6b9b-bb67-4159-8746-002d9cc07694 for instance 704f353f-861e-47cf-9625-7210f9f1f81e on hv-cinder-85827 Sep 20 22:26:24.298039 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-9d035478-3ac7-45bb-a6d8-a3f1187f2747 req-091f6bc5-3724-4fe8-82c0-2aa714337fe2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060841 Sep 20 22:26:24.298832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 195/373] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:26:24.330528 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c2b5cfcf-d187-4c7b-ae4f-bca79a2e0edc tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:24.331130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c2b5cfcf-d187-4c7b-ae4f-bca79a2e0edc tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:24.348444 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c2b5cfcf-d187-4c7b-ae4f-bca79a2e0edc tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:24.349320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c2b5cfcf-d187-4c7b-ae4f-bca79a2e0edc tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:24.349943 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c2b5cfcf-d187-4c7b-ae4f-bca79a2e0edc tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:24.350916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c2b5cfcf-d187-4c7b-ae4f-bca79a2e0edc tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:24.351363 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c2b5cfcf-d187-4c7b-ae4f-bca79a2e0edc tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:24.351931 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c2b5cfcf-d187-4c7b-ae4f-bca79a2e0edc tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:24.469763 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-d70cc8a8-97aa-4bfc-a4cf-2f5a4cb9fcf4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:24.470902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-d70cc8a8-97aa-4bfc-a4cf-2f5a4cb9fcf4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:24.478403 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d70cc8a8-97aa-4bfc-a4cf-2f5a4cb9fcf4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:24.479121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d70cc8a8-97aa-4bfc-a4cf-2f5a4cb9fcf4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:24.479762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d70cc8a8-97aa-4bfc-a4cf-2f5a4cb9fcf4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:24.480668 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d70cc8a8-97aa-4bfc-a4cf-2f5a4cb9fcf4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:24.481344 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d70cc8a8-97aa-4bfc-a4cf-2f5a4cb9fcf4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:24.481952 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d70cc8a8-97aa-4bfc-a4cf-2f5a4cb9fcf4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:24.740344 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-d70cc8a8-97aa-4bfc-a4cf-2f5a4cb9fcf4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:24.750586 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c2b5cfcf-d187-4c7b-ae4f-bca79a2e0edc tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:24.760185 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-d70cc8a8-97aa-4bfc-a4cf-2f5a4cb9fcf4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1371 microversion: 2.1 time: 0.297910 Sep 20 22:26:24.761385 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 196/374] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:24 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:24.763347 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c2b5cfcf-d187-4c7b-ae4f-bca79a2e0edc tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:24.765267 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c2b5cfcf-d187-4c7b-ae4f-bca79a2e0edc tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:24.766685 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-c2b5cfcf-d187-4c7b-ae4f-bca79a2e0edc tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1739 microversion: 2.20 time: 0.440050 Sep 20 22:26:24.767758 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 179/375] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:24 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1739 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:25.264222 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-66d28fc0-7d6e-4be4-b40f-1299dc09e23a req-c8aa2845-0cb8-4759-b9e5-9ab8bcca5d6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a507bbd4-a0a2-4ca8-b04a-1511797060be", "tag": "87454e86-c277-4775-8223-737852068e10"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:26:25.276834 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-66d28fc0-7d6e-4be4-b40f-1299dc09e23a req-c8aa2845-0cb8-4759-b9e5-9ab8bcca5d6d service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:25.277557 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-66d28fc0-7d6e-4be4-b40f-1299dc09e23a req-c8aa2845-0cb8-4759-b9e5-9ab8bcca5d6d service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:25.278019 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-66d28fc0-7d6e-4be4-b40f-1299dc09e23a req-c8aa2845-0cb8-4759-b9e5-9ab8bcca5d6d service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:25.292002 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-66d28fc0-7d6e-4be4-b40f-1299dc09e23a req-c8aa2845-0cb8-4759-b9e5-9ab8bcca5d6d service nova] Creating event network-changed:87454e86-c277-4775-8223-737852068e10 for instance a507bbd4-a0a2-4ca8-b04a-1511797060be on hv-cinder-85827 Sep 20 22:26:25.297386 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-66d28fc0-7d6e-4be4-b40f-1299dc09e23a req-c8aa2845-0cb8-4759-b9e5-9ab8bcca5d6d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038732 Sep 20 22:26:25.298520 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 197/376] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:26:25.784700 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ec26d2a3-7c11-4973-8377-409b5197fb6a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:25.785457 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ec26d2a3-7c11-4973-8377-409b5197fb6a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:25.793392 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ec26d2a3-7c11-4973-8377-409b5197fb6a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:25.796152 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ec26d2a3-7c11-4973-8377-409b5197fb6a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:25.800244 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-62910089-ef9e-4fc4-ab9f-21fc9ee60663 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:25.801174 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-62910089-ef9e-4fc4-ab9f-21fc9ee60663 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:25.807110 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ec26d2a3-7c11-4973-8377-409b5197fb6a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:25.808414 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ec26d2a3-7c11-4973-8377-409b5197fb6a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:25.810803 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ec26d2a3-7c11-4973-8377-409b5197fb6a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:25.811413 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ec26d2a3-7c11-4973-8377-409b5197fb6a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:25.811589 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-62910089-ef9e-4fc4-ab9f-21fc9ee60663 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:25.812149 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-62910089-ef9e-4fc4-ab9f-21fc9ee60663 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:25.812579 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-62910089-ef9e-4fc4-ab9f-21fc9ee60663 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:25.817611 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-62910089-ef9e-4fc4-ab9f-21fc9ee60663 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:25.818304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-62910089-ef9e-4fc4-ab9f-21fc9ee60663 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:25.819006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-62910089-ef9e-4fc4-ab9f-21fc9ee60663 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:26.004718 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ec26d2a3-7c11-4973-8377-409b5197fb6a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:26.015082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ec26d2a3-7c11-4973-8377-409b5197fb6a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1371 microversion: 2.1 time: 0.235419 Sep 20 22:26:26.015637 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 180/377] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:25 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:26.080278 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-62910089-ef9e-4fc4-ab9f-21fc9ee60663 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:26.091928 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-62910089-ef9e-4fc4-ab9f-21fc9ee60663 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:26.093533 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-62910089-ef9e-4fc4-ab9f-21fc9ee60663 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:26.094959 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-62910089-ef9e-4fc4-ab9f-21fc9ee60663 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1739 microversion: 2.20 time: 0.299737 Sep 20 22:26:26.095581 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 198/378] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:25 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1739 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:27.042298 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-09a23557-d971-45ee-8f15-b294b7cca404 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:27.043149 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-09a23557-d971-45ee-8f15-b294b7cca404 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:27.050313 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-09a23557-d971-45ee-8f15-b294b7cca404 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:27.051651 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-09a23557-d971-45ee-8f15-b294b7cca404 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:27.052862 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-09a23557-d971-45ee-8f15-b294b7cca404 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:27.054698 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-09a23557-d971-45ee-8f15-b294b7cca404 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:27.055840 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-09a23557-d971-45ee-8f15-b294b7cca404 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:27.057076 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-09a23557-d971-45ee-8f15-b294b7cca404 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:27.121634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a87e9ccb-7468-42c3-b6e2-a56b6899225a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:27.122461 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a87e9ccb-7468-42c3-b6e2-a56b6899225a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:27.129728 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a87e9ccb-7468-42c3-b6e2-a56b6899225a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:27.130124 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a87e9ccb-7468-42c3-b6e2-a56b6899225a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:27.130554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a87e9ccb-7468-42c3-b6e2-a56b6899225a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:27.131233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a87e9ccb-7468-42c3-b6e2-a56b6899225a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:27.131864 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a87e9ccb-7468-42c3-b6e2-a56b6899225a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:27.132313 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a87e9ccb-7468-42c3-b6e2-a56b6899225a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:27.152185 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=100 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:27.255020 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-09a23557-d971-45ee-8f15-b294b7cca404 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:27.264904 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-09a23557-d971-45ee-8f15-b294b7cca404 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1371 microversion: 2.1 time: 0.227602 Sep 20 22:26:27.267542 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 181/379] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:27 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:27.320762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a87e9ccb-7468-42c3-b6e2-a56b6899225a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:27.329761 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a87e9ccb-7468-42c3-b6e2-a56b6899225a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:27.331264 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a87e9ccb-7468-42c3-b6e2-a56b6899225a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:27.332565 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a87e9ccb-7468-42c3-b6e2-a56b6899225a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1739 microversion: 2.20 time: 0.214852 Sep 20 22:26:27.333383 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 199/380] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:27 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:28.288435 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-f3677476-dc39-47b6-bab6-7e91b0b959b4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:28.289063 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-f3677476-dc39-47b6-bab6-7e91b0b959b4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:28.295844 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f3677476-dc39-47b6-bab6-7e91b0b959b4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:28.296336 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f3677476-dc39-47b6-bab6-7e91b0b959b4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:28.296791 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f3677476-dc39-47b6-bab6-7e91b0b959b4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:28.297457 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f3677476-dc39-47b6-bab6-7e91b0b959b4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:28.298108 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f3677476-dc39-47b6-bab6-7e91b0b959b4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:28.298734 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f3677476-dc39-47b6-bab6-7e91b0b959b4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:28.358933 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-28cf2d75-de78-4c66-9524-45e08b0435e7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:28.359551 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-28cf2d75-de78-4c66-9524-45e08b0435e7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:28.366716 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-28cf2d75-de78-4c66-9524-45e08b0435e7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:28.367214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-28cf2d75-de78-4c66-9524-45e08b0435e7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:28.367646 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-28cf2d75-de78-4c66-9524-45e08b0435e7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:28.368350 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-28cf2d75-de78-4c66-9524-45e08b0435e7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:28.368800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-28cf2d75-de78-4c66-9524-45e08b0435e7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:28.369251 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-28cf2d75-de78-4c66-9524-45e08b0435e7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:28.434897 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f3677476-dc39-47b6-bab6-7e91b0b959b4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:28.442591 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-f3677476-dc39-47b6-bab6-7e91b0b959b4 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1371 microversion: 2.1 time: 0.158001 Sep 20 22:26:28.443422 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 182/381] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:28 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:26:28.503094 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-28cf2d75-de78-4c66-9524-45e08b0435e7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:28.511684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-28cf2d75-de78-4c66-9524-45e08b0435e7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:28.513155 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-28cf2d75-de78-4c66-9524-45e08b0435e7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:28.514294 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-28cf2d75-de78-4c66-9524-45e08b0435e7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1739 microversion: 2.20 time: 0.159305 Sep 20 22:26:28.514848 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 200/382] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:28 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:26:29.468519 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-1f83ff72-9c23-4630-a13b-0a6e666ad540 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:29.470045 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-1f83ff72-9c23-4630-a13b-0a6e666ad540 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:29.478249 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1f83ff72-9c23-4630-a13b-0a6e666ad540 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:29.479072 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1f83ff72-9c23-4630-a13b-0a6e666ad540 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:29.479945 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1f83ff72-9c23-4630-a13b-0a6e666ad540 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:29.480940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1f83ff72-9c23-4630-a13b-0a6e666ad540 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:29.481690 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1f83ff72-9c23-4630-a13b-0a6e666ad540 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:29.482353 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1f83ff72-9c23-4630-a13b-0a6e666ad540 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:29.540216 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-03b9e1b3-e9f0-407f-b753-7deed1600f17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:29.541640 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-03b9e1b3-e9f0-407f-b753-7deed1600f17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:29.549301 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=2 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:29.555542 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-03b9e1b3-e9f0-407f-b753-7deed1600f17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:29.556324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-03b9e1b3-e9f0-407f-b753-7deed1600f17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:29.557494 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-03b9e1b3-e9f0-407f-b753-7deed1600f17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:29.559237 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-03b9e1b3-e9f0-407f-b753-7deed1600f17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:29.560053 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-03b9e1b3-e9f0-407f-b753-7deed1600f17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:29.560927 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-03b9e1b3-e9f0-407f-b753-7deed1600f17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:29.568281 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=6 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:29.640887 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-1f83ff72-9c23-4630-a13b-0a6e666ad540 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:29.649295 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-1f83ff72-9c23-4630-a13b-0a6e666ad540 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1371 microversion: 2.1 time: 0.185702 Sep 20 22:26:29.654846 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 183/383] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:29 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:26:29.702446 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=2 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:29.752310 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-03b9e1b3-e9f0-407f-b753-7deed1600f17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:29.760122 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-03b9e1b3-e9f0-407f-b753-7deed1600f17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:29.761924 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-03b9e1b3-e9f0-407f-b753-7deed1600f17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:29.763781 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-03b9e1b3-e9f0-407f-b753-7deed1600f17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1739 microversion: 2.20 time: 0.227552 Sep 20 22:26:29.781527 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 201/384] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:29 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:26:30.195619 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-6e424667-0188-4c01-8951-d289e5a36141 req-6fd4ed22-e0f6-4cec-8a4a-488a9289e545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704f353f-861e-47cf-9625-7210f9f1f81e", "name": "network-vif-plugged", "status": "completed", "tag": "514d6b9b-bb67-4159-8746-002d9cc07694"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:26:30.215640 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-6e424667-0188-4c01-8951-d289e5a36141 req-6fd4ed22-e0f6-4cec-8a4a-488a9289e545 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:30.216083 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-6e424667-0188-4c01-8951-d289e5a36141 req-6fd4ed22-e0f6-4cec-8a4a-488a9289e545 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:30.216792 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-6e424667-0188-4c01-8951-d289e5a36141 req-6fd4ed22-e0f6-4cec-8a4a-488a9289e545 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:30.242269 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-6e424667-0188-4c01-8951-d289e5a36141 req-6fd4ed22-e0f6-4cec-8a4a-488a9289e545 service nova] Creating event network-vif-plugged:514d6b9b-bb67-4159-8746-002d9cc07694 for instance 704f353f-861e-47cf-9625-7210f9f1f81e on hv-cinder-85827 Sep 20 22:26:30.256723 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-6e424667-0188-4c01-8951-d289e5a36141 req-6fd4ed22-e0f6-4cec-8a4a-488a9289e545 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066478 Sep 20 22:26:30.258381 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 184/385] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:26:30.673406 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4499231f-1cf2-4378-8f70-e6f15cda6ef8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:30.674656 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4499231f-1cf2-4378-8f70-e6f15cda6ef8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:30.682016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4499231f-1cf2-4378-8f70-e6f15cda6ef8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:30.682501 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4499231f-1cf2-4378-8f70-e6f15cda6ef8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:30.683094 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4499231f-1cf2-4378-8f70-e6f15cda6ef8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:30.683791 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4499231f-1cf2-4378-8f70-e6f15cda6ef8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:30.684253 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4499231f-1cf2-4378-8f70-e6f15cda6ef8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:30.684708 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4499231f-1cf2-4378-8f70-e6f15cda6ef8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:30.793184 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ecaacd10-0c7a-4793-adc2-19378d8bc68e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:30.793798 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ecaacd10-0c7a-4793-adc2-19378d8bc68e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:30.801478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ecaacd10-0c7a-4793-adc2-19378d8bc68e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:30.802064 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ecaacd10-0c7a-4793-adc2-19378d8bc68e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:30.802592 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ecaacd10-0c7a-4793-adc2-19378d8bc68e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:30.803370 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ecaacd10-0c7a-4793-adc2-19378d8bc68e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:30.804516 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ecaacd10-0c7a-4793-adc2-19378d8bc68e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:30.805215 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ecaacd10-0c7a-4793-adc2-19378d8bc68e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:30.849919 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4499231f-1cf2-4378-8f70-e6f15cda6ef8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:30.872511 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4499231f-1cf2-4378-8f70-e6f15cda6ef8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1371 microversion: 2.1 time: 0.202803 Sep 20 22:26:30.889333 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 202/386] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:30 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:30.984455 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ecaacd10-0c7a-4793-adc2-19378d8bc68e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:30.993782 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ecaacd10-0c7a-4793-adc2-19378d8bc68e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:30.995224 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ecaacd10-0c7a-4793-adc2-19378d8bc68e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:30.996491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ecaacd10-0c7a-4793-adc2-19378d8bc68e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1739 microversion: 2.20 time: 0.208303 Sep 20 22:26:31.013567 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 185/387] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:30 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:26:31.895714 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-d9481603-12c1-43be-ae70-c41044397a13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:31.896328 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-d9481603-12c1-43be-ae70-c41044397a13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:31.902881 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d9481603-12c1-43be-ae70-c41044397a13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:31.903374 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d9481603-12c1-43be-ae70-c41044397a13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:31.903812 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d9481603-12c1-43be-ae70-c41044397a13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:31.904502 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d9481603-12c1-43be-ae70-c41044397a13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:31.904956 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d9481603-12c1-43be-ae70-c41044397a13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:31.905414 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d9481603-12c1-43be-ae70-c41044397a13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:32.023382 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-53326362-de37-45ec-81b9-767468894c39 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:32.023980 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-53326362-de37-45ec-81b9-767468894c39 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:32.030552 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-53326362-de37-45ec-81b9-767468894c39 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:32.031042 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-53326362-de37-45ec-81b9-767468894c39 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:32.031484 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-53326362-de37-45ec-81b9-767468894c39 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:32.032377 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-53326362-de37-45ec-81b9-767468894c39 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:32.033033 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-53326362-de37-45ec-81b9-767468894c39 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:32.033468 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-53326362-de37-45ec-81b9-767468894c39 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:32.040599 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-d9481603-12c1-43be-ae70-c41044397a13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:32.065059 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-d9481603-12c1-43be-ae70-c41044397a13 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1371 microversion: 2.1 time: 0.173136 Sep 20 22:26:32.068329 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 203/388] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:31 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:32.185209 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-53326362-de37-45ec-81b9-767468894c39 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:32.193371 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-53326362-de37-45ec-81b9-767468894c39 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:32.194880 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-53326362-de37-45ec-81b9-767468894c39 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:32.196375 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-53326362-de37-45ec-81b9-767468894c39 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1739 microversion: 2.20 time: 0.176709 Sep 20 22:26:32.196934 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 186/389] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:32 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:26:33.091685 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5cf7a08b-29b8-4ad3-8aae-5e25d3dd989d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:33.092286 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5cf7a08b-29b8-4ad3-8aae-5e25d3dd989d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:33.098944 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5cf7a08b-29b8-4ad3-8aae-5e25d3dd989d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:33.099427 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5cf7a08b-29b8-4ad3-8aae-5e25d3dd989d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:33.099856 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5cf7a08b-29b8-4ad3-8aae-5e25d3dd989d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:33.101070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5cf7a08b-29b8-4ad3-8aae-5e25d3dd989d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:33.101524 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5cf7a08b-29b8-4ad3-8aae-5e25d3dd989d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:33.101944 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5cf7a08b-29b8-4ad3-8aae-5e25d3dd989d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:33.222347 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6ee065fc-fab1-42bc-80c3-f7f99713eac3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:33.222952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-6ee065fc-fab1-42bc-80c3-f7f99713eac3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:33.229468 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6ee065fc-fab1-42bc-80c3-f7f99713eac3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:33.229947 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6ee065fc-fab1-42bc-80c3-f7f99713eac3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:33.230378 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6ee065fc-fab1-42bc-80c3-f7f99713eac3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:33.231069 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6ee065fc-fab1-42bc-80c3-f7f99713eac3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:33.231517 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6ee065fc-fab1-42bc-80c3-f7f99713eac3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:33.231933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6ee065fc-fab1-42bc-80c3-f7f99713eac3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:33.249509 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-5cf7a08b-29b8-4ad3-8aae-5e25d3dd989d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:33.257257 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5cf7a08b-29b8-4ad3-8aae-5e25d3dd989d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1564 microversion: 2.1 time: 0.169256 Sep 20 22:26:33.257827 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 204/390] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:33 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:33.279221 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-40d38b84-04a8-4851-9da1-abae165768cb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:33.279704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-40d38b84-04a8-4851-9da1-abae165768cb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:33.285554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-40d38b84-04a8-4851-9da1-abae165768cb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:33.286016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-40d38b84-04a8-4851-9da1-abae165768cb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:33.286445 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-40d38b84-04a8-4851-9da1-abae165768cb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:33.287135 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-40d38b84-04a8-4851-9da1-abae165768cb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:33.287566 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-40d38b84-04a8-4851-9da1-abae165768cb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:33.288501 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-40d38b84-04a8-4851-9da1-abae165768cb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:33.363000 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-6ee065fc-fab1-42bc-80c3-f7f99713eac3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:33.363184 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-40d38b84-04a8-4851-9da1-abae165768cb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087820 Sep 20 22:26:33.363724 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 205/391] 10.222.0.16 () {58 vars in 1275 bytes} [Tue Sep 20 22:26:33 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:26:33.372251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-6ee065fc-fab1-42bc-80c3-f7f99713eac3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:33.373764 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-6ee065fc-fab1-42bc-80c3-f7f99713eac3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:33.374927 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-6ee065fc-fab1-42bc-80c3-f7f99713eac3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1721 microversion: 2.20 time: 0.156516 Sep 20 22:26:33.375480 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 187/392] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:33 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:26:34.400704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4dc5f3cc-027c-426c-b627-55c80cfbb924 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:34.401357 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4dc5f3cc-027c-426c-b627-55c80cfbb924 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:34.407301 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4dc5f3cc-027c-426c-b627-55c80cfbb924 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:34.407785 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4dc5f3cc-027c-426c-b627-55c80cfbb924 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:34.408225 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4dc5f3cc-027c-426c-b627-55c80cfbb924 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:34.408923 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4dc5f3cc-027c-426c-b627-55c80cfbb924 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:34.409404 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4dc5f3cc-027c-426c-b627-55c80cfbb924 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:34.409824 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4dc5f3cc-027c-426c-b627-55c80cfbb924 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:34.528581 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-de21f6c4-064b-498d-9e56-ed0aad2fb7aa req-3a59aa2a-7669-40bb-b58b-f5dc7b513461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704f353f-861e-47cf-9625-7210f9f1f81e", "tag": "514d6b9b-bb67-4159-8746-002d9cc07694"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:26:34.538181 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-de21f6c4-064b-498d-9e56-ed0aad2fb7aa req-3a59aa2a-7669-40bb-b58b-f5dc7b513461 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:34.538662 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-de21f6c4-064b-498d-9e56-ed0aad2fb7aa req-3a59aa2a-7669-40bb-b58b-f5dc7b513461 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:34.539087 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-de21f6c4-064b-498d-9e56-ed0aad2fb7aa req-3a59aa2a-7669-40bb-b58b-f5dc7b513461 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:34.550807 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-de21f6c4-064b-498d-9e56-ed0aad2fb7aa req-3a59aa2a-7669-40bb-b58b-f5dc7b513461 service nova] Creating event network-changed:514d6b9b-bb67-4159-8746-002d9cc07694 for instance 704f353f-861e-47cf-9625-7210f9f1f81e on hv-cinder-85827 Sep 20 22:26:34.556728 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4dc5f3cc-027c-426c-b627-55c80cfbb924 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:34.557002 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-de21f6c4-064b-498d-9e56-ed0aad2fb7aa req-3a59aa2a-7669-40bb-b58b-f5dc7b513461 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031819 Sep 20 22:26:34.557686 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 188/393] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:26:34.565433 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4dc5f3cc-027c-426c-b627-55c80cfbb924 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:34.566905 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4dc5f3cc-027c-426c-b627-55c80cfbb924 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:34.568069 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4dc5f3cc-027c-426c-b627-55c80cfbb924 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1721 microversion: 2.20 time: 0.172344 Sep 20 22:26:34.568619 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 206/394] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:34 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:35.595129 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-86f09145-7ced-4eb4-aa31-c827c8423189 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:35.595788 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-86f09145-7ced-4eb4-aa31-c827c8423189 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:35.597715 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:35.604963 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-86f09145-7ced-4eb4-aa31-c827c8423189 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:35.605468 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-86f09145-7ced-4eb4-aa31-c827c8423189 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:35.605900 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-86f09145-7ced-4eb4-aa31-c827c8423189 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:35.606585 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-86f09145-7ced-4eb4-aa31-c827c8423189 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:35.607037 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-86f09145-7ced-4eb4-aa31-c827c8423189 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:35.607452 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-86f09145-7ced-4eb4-aa31-c827c8423189 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:35.753037 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-86f09145-7ced-4eb4-aa31-c827c8423189 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:35.760937 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-86f09145-7ced-4eb4-aa31-c827c8423189 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:35.762404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-86f09145-7ced-4eb4-aa31-c827c8423189 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:35.763553 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-86f09145-7ced-4eb4-aa31-c827c8423189 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1721 microversion: 2.20 time: 0.173247 Sep 20 22:26:35.764102 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 189/395] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:35 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:36.165293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-158c1f43-a83d-4013-9ac7-1735100e403a req-07be30d9-6334-4d9a-9179-8384e366abc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d58779-65b7-4b97-8536-eef4357a475d", "name": "network-vif-unplugged", "status": "completed", "tag": "d965769d-834a-4b9f-817a-24e086032c2d"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:26:36.177217 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-158c1f43-a83d-4013-9ac7-1735100e403a req-07be30d9-6334-4d9a-9179-8384e366abc6 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:36.178073 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-158c1f43-a83d-4013-9ac7-1735100e403a req-07be30d9-6334-4d9a-9179-8384e366abc6 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:36.178515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-158c1f43-a83d-4013-9ac7-1735100e403a req-07be30d9-6334-4d9a-9179-8384e366abc6 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:36.189582 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-158c1f43-a83d-4013-9ac7-1735100e403a req-07be30d9-6334-4d9a-9179-8384e366abc6 service nova] Creating event network-vif-unplugged:d965769d-834a-4b9f-817a-24e086032c2d for instance 48d58779-65b7-4b97-8536-eef4357a475d on hv-cinder-85827 Sep 20 22:26:36.195072 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-158c1f43-a83d-4013-9ac7-1735100e403a req-07be30d9-6334-4d9a-9179-8384e366abc6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033080 Sep 20 22:26:36.195692 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 207/396] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:26:36.789306 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ffaadbc1-6254-4450-86d3-025eb86b3227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:36.789840 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ffaadbc1-6254-4450-86d3-025eb86b3227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:36.796191 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ffaadbc1-6254-4450-86d3-025eb86b3227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:36.796676 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ffaadbc1-6254-4450-86d3-025eb86b3227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:36.797140 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ffaadbc1-6254-4450-86d3-025eb86b3227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:36.797830 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ffaadbc1-6254-4450-86d3-025eb86b3227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:36.798278 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ffaadbc1-6254-4450-86d3-025eb86b3227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:36.798699 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ffaadbc1-6254-4450-86d3-025eb86b3227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:36.925070 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ffaadbc1-6254-4450-86d3-025eb86b3227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:36.933867 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ffaadbc1-6254-4450-86d3-025eb86b3227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:36.935342 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ffaadbc1-6254-4450-86d3-025eb86b3227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:36.936484 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ffaadbc1-6254-4450-86d3-025eb86b3227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1721 microversion: 2.20 time: 0.151751 Sep 20 22:26:36.937042 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 190/397] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:36 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:37.963999 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-eed44847-90f8-4b0b-b137-e2c9e7186df6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:37.964700 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-eed44847-90f8-4b0b-b137-e2c9e7186df6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:37.971444 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eed44847-90f8-4b0b-b137-e2c9e7186df6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:37.971926 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eed44847-90f8-4b0b-b137-e2c9e7186df6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:37.972360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eed44847-90f8-4b0b-b137-e2c9e7186df6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:37.973076 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eed44847-90f8-4b0b-b137-e2c9e7186df6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:37.973533 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eed44847-90f8-4b0b-b137-e2c9e7186df6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:37.973954 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eed44847-90f8-4b0b-b137-e2c9e7186df6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:38.120163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-eed44847-90f8-4b0b-b137-e2c9e7186df6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:38.128557 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-eed44847-90f8-4b0b-b137-e2c9e7186df6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:38.130051 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-eed44847-90f8-4b0b-b137-e2c9e7186df6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:38.131205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-eed44847-90f8-4b0b-b137-e2c9e7186df6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1721 microversion: 2.20 time: 0.171624 Sep 20 22:26:38.132419 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 208/398] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:37 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:39.158148 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-632c9841-6a47-4555-a953-bf7023727c7a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:39.158876 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-632c9841-6a47-4555-a953-bf7023727c7a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:39.165668 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-632c9841-6a47-4555-a953-bf7023727c7a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:39.166548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-632c9841-6a47-4555-a953-bf7023727c7a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:39.167081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-632c9841-6a47-4555-a953-bf7023727c7a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:39.167899 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-632c9841-6a47-4555-a953-bf7023727c7a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:39.168456 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-632c9841-6a47-4555-a953-bf7023727c7a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:39.169075 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-632c9841-6a47-4555-a953-bf7023727c7a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:39.327677 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-632c9841-6a47-4555-a953-bf7023727c7a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:39.337555 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-632c9841-6a47-4555-a953-bf7023727c7a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:39.339172 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-632c9841-6a47-4555-a953-bf7023727c7a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:39.340369 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-632c9841-6a47-4555-a953-bf7023727c7a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1664 microversion: 2.20 time: 0.186303 Sep 20 22:26:39.340920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 191/399] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:39 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1664 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:39.365159 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-92cdea96-eb84-4e7d-b824-dd4a30674591 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "411488ba-a37d-4582-9d90-3635ed107124"}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:26:39.368248 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-92cdea96-eb84-4e7d-b824-dd4a30674591 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:39.374495 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-92cdea96-eb84-4e7d-b824-dd4a30674591 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:39.374973 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-92cdea96-eb84-4e7d-b824-dd4a30674591 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:39.375448 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-92cdea96-eb84-4e7d-b824-dd4a30674591 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:39.376129 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-92cdea96-eb84-4e7d-b824-dd4a30674591 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:39.376754 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-92cdea96-eb84-4e7d-b824-dd4a30674591 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:39.377138 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-92cdea96-eb84-4e7d-b824-dd4a30674591 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:39.679951 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-92cdea96-eb84-4e7d-b824-dd4a30674591 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "POST /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.318666 Sep 20 22:26:39.680633 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 209/400] 10.222.0.16 () {62 vars in 1364 bytes} [Tue Sep 20 22:26:39 2022] POST /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/os-volume_attachments => generated 188 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:26:39.810069 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-1e5dc2d9-1c77-445f-8068-a1910da48008 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:26:39.810708 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-1e5dc2d9-1c77-445f-8068-a1910da48008 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:39.816748 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1e5dc2d9-1c77-445f-8068-a1910da48008 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:39.817277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1e5dc2d9-1c77-445f-8068-a1910da48008 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:39.817719 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1e5dc2d9-1c77-445f-8068-a1910da48008 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:39.818418 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1e5dc2d9-1c77-445f-8068-a1910da48008 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:39.818875 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1e5dc2d9-1c77-445f-8068-a1910da48008 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:39.819824 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1e5dc2d9-1c77-445f-8068-a1910da48008 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:39.863839 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-1e5dc2d9-1c77-445f-8068-a1910da48008 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120473) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 20 22:26:39.930189 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-1e5dc2d9-1c77-445f-8068-a1910da48008 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "POST /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/action" status: 202 len: 0 microversion: 2.20 time: 0.124150 Sep 20 22:26:39.930827 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 192/401] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Sep 20 22:26:39 2022] POST /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:26:39.938962 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-86c62631-6765-459b-a412-4c1460e354fb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:39.939575 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-86c62631-6765-459b-a412-4c1460e354fb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:39.946715 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-86c62631-6765-459b-a412-4c1460e354fb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:39.947190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-86c62631-6765-459b-a412-4c1460e354fb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:39.947617 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-86c62631-6765-459b-a412-4c1460e354fb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:39.948297 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-86c62631-6765-459b-a412-4c1460e354fb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:39.948746 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-86c62631-6765-459b-a412-4c1460e354fb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:39.949200 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-86c62631-6765-459b-a412-4c1460e354fb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:40.082719 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-86c62631-6765-459b-a412-4c1460e354fb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:40.092352 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-86c62631-6765-459b-a412-4c1460e354fb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:40.093817 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-86c62631-6765-459b-a412-4c1460e354fb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:40.094968 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-86c62631-6765-459b-a412-4c1460e354fb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1750 microversion: 2.20 time: 0.159928 Sep 20 22:26:40.095520 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 210/402] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:39 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:41.120584 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d50fcbeb-dc25-4e8a-8c8e-b38feae19d4b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:41.121306 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d50fcbeb-dc25-4e8a-8c8e-b38feae19d4b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:41.130376 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d50fcbeb-dc25-4e8a-8c8e-b38feae19d4b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:41.130660 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d50fcbeb-dc25-4e8a-8c8e-b38feae19d4b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:41.131092 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d50fcbeb-dc25-4e8a-8c8e-b38feae19d4b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:41.131849 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d50fcbeb-dc25-4e8a-8c8e-b38feae19d4b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:41.132281 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d50fcbeb-dc25-4e8a-8c8e-b38feae19d4b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:41.133865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d50fcbeb-dc25-4e8a-8c8e-b38feae19d4b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:41.279416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-d50fcbeb-dc25-4e8a-8c8e-b38feae19d4b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:41.288544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-d50fcbeb-dc25-4e8a-8c8e-b38feae19d4b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:41.290096 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-d50fcbeb-dc25-4e8a-8c8e-b38feae19d4b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:41.291286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-d50fcbeb-dc25-4e8a-8c8e-b38feae19d4b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1752 microversion: 2.20 time: 0.175404 Sep 20 22:26:41.291853 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 193/403] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:41 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:42.317406 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-53de1c32-fc81-433a-94f6-53d736bf8323 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:42.317943 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-53de1c32-fc81-433a-94f6-53d736bf8323 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:42.326164 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-53de1c32-fc81-433a-94f6-53d736bf8323 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:42.326643 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-53de1c32-fc81-433a-94f6-53d736bf8323 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:42.327072 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-53de1c32-fc81-433a-94f6-53d736bf8323 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:42.328036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-53de1c32-fc81-433a-94f6-53d736bf8323 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:42.328494 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-53de1c32-fc81-433a-94f6-53d736bf8323 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:42.328910 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-53de1c32-fc81-433a-94f6-53d736bf8323 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:42.462534 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-53de1c32-fc81-433a-94f6-53d736bf8323 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:42.470984 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-53de1c32-fc81-433a-94f6-53d736bf8323 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:42.472442 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-53de1c32-fc81-433a-94f6-53d736bf8323 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:42.473633 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-53de1c32-fc81-433a-94f6-53d736bf8323 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1752 microversion: 2.20 time: 0.160146 Sep 20 22:26:42.474198 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 211/404] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:42 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:43.500004 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-734b721a-1a9b-49ad-98be-24594da68482 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:43.500614 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-734b721a-1a9b-49ad-98be-24594da68482 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:43.507573 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-734b721a-1a9b-49ad-98be-24594da68482 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:43.508054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-734b721a-1a9b-49ad-98be-24594da68482 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:43.508485 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-734b721a-1a9b-49ad-98be-24594da68482 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:43.509199 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-734b721a-1a9b-49ad-98be-24594da68482 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:43.509655 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-734b721a-1a9b-49ad-98be-24594da68482 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:43.510072 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-734b721a-1a9b-49ad-98be-24594da68482 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:43.637245 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-734b721a-1a9b-49ad-98be-24594da68482 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:43.646088 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-734b721a-1a9b-49ad-98be-24594da68482 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:43.647549 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-734b721a-1a9b-49ad-98be-24594da68482 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:43.648697 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-734b721a-1a9b-49ad-98be-24594da68482 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1752 microversion: 2.20 time: 0.152679 Sep 20 22:26:43.649281 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 194/405] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:43 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:44.673646 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a039e0cf-df80-4037-bd73-47cf3d66a17e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:44.674274 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a039e0cf-df80-4037-bd73-47cf3d66a17e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:44.681955 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a039e0cf-df80-4037-bd73-47cf3d66a17e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:44.682445 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a039e0cf-df80-4037-bd73-47cf3d66a17e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:44.682963 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a039e0cf-df80-4037-bd73-47cf3d66a17e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:44.683659 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a039e0cf-df80-4037-bd73-47cf3d66a17e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:44.684109 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a039e0cf-df80-4037-bd73-47cf3d66a17e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:44.684617 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a039e0cf-df80-4037-bd73-47cf3d66a17e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:44.820065 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a039e0cf-df80-4037-bd73-47cf3d66a17e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:44.829729 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a039e0cf-df80-4037-bd73-47cf3d66a17e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:44.831618 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a039e0cf-df80-4037-bd73-47cf3d66a17e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:44.833095 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a039e0cf-df80-4037-bd73-47cf3d66a17e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1752 microversion: 2.20 time: 0.163090 Sep 20 22:26:44.833489 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 212/406] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:44 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:45.859452 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-7f50d934-658b-495d-b66c-7e3841854ed9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:45.860148 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-7f50d934-658b-495d-b66c-7e3841854ed9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:45.867549 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7f50d934-658b-495d-b66c-7e3841854ed9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:45.868039 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7f50d934-658b-495d-b66c-7e3841854ed9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:45.868471 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7f50d934-658b-495d-b66c-7e3841854ed9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:45.869873 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7f50d934-658b-495d-b66c-7e3841854ed9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:45.870504 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7f50d934-658b-495d-b66c-7e3841854ed9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:45.870931 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7f50d934-658b-495d-b66c-7e3841854ed9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:45.886979 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:46.070642 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-7f50d934-658b-495d-b66c-7e3841854ed9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:46.079294 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-7f50d934-658b-495d-b66c-7e3841854ed9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:46.080747 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-7f50d934-658b-495d-b66c-7e3841854ed9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:46.081922 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-7f50d934-658b-495d-b66c-7e3841854ed9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.226938 Sep 20 22:26:46.082480 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 195/407] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:45 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:47.108092 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-fa845cd1-e80e-4ef1-91d3-cba1b97d28af tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:47.108700 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-fa845cd1-e80e-4ef1-91d3-cba1b97d28af tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:47.115466 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fa845cd1-e80e-4ef1-91d3-cba1b97d28af tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:47.116497 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fa845cd1-e80e-4ef1-91d3-cba1b97d28af tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:47.116926 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fa845cd1-e80e-4ef1-91d3-cba1b97d28af tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:47.117639 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fa845cd1-e80e-4ef1-91d3-cba1b97d28af tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:47.118086 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fa845cd1-e80e-4ef1-91d3-cba1b97d28af tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:47.118503 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fa845cd1-e80e-4ef1-91d3-cba1b97d28af tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:47.508997 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-fa845cd1-e80e-4ef1-91d3-cba1b97d28af tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:47.528825 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-fa845cd1-e80e-4ef1-91d3-cba1b97d28af tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:47.530596 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-fa845cd1-e80e-4ef1-91d3-cba1b97d28af tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:47.531836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-fa845cd1-e80e-4ef1-91d3-cba1b97d28af tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.428106 Sep 20 22:26:47.532598 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 213/408] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:47 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:26:48.557706 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-9f6e7f92-94be-4b5c-86f0-55ab4fde1cd3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:48.558316 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-9f6e7f92-94be-4b5c-86f0-55ab4fde1cd3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:48.564730 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9f6e7f92-94be-4b5c-86f0-55ab4fde1cd3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:48.565245 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9f6e7f92-94be-4b5c-86f0-55ab4fde1cd3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:48.565729 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9f6e7f92-94be-4b5c-86f0-55ab4fde1cd3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:48.566420 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9f6e7f92-94be-4b5c-86f0-55ab4fde1cd3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:48.566873 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9f6e7f92-94be-4b5c-86f0-55ab4fde1cd3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:48.567293 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9f6e7f92-94be-4b5c-86f0-55ab4fde1cd3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:48.709861 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-9f6e7f92-94be-4b5c-86f0-55ab4fde1cd3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:48.719773 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-9f6e7f92-94be-4b5c-86f0-55ab4fde1cd3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:48.721463 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-9f6e7f92-94be-4b5c-86f0-55ab4fde1cd3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:48.722700 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-9f6e7f92-94be-4b5c-86f0-55ab4fde1cd3 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.168845 Sep 20 22:26:48.723516 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 196/409] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:48 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:49.749420 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9b8c6810-e118-48a1-9671-ef8c9aea1b45 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:49.750058 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9b8c6810-e118-48a1-9671-ef8c9aea1b45 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:49.752585 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=53 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:49.757802 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9b8c6810-e118-48a1-9671-ef8c9aea1b45 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:49.758284 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9b8c6810-e118-48a1-9671-ef8c9aea1b45 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:49.758715 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9b8c6810-e118-48a1-9671-ef8c9aea1b45 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:49.759399 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9b8c6810-e118-48a1-9671-ef8c9aea1b45 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:49.759850 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9b8c6810-e118-48a1-9671-ef8c9aea1b45 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:49.760269 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9b8c6810-e118-48a1-9671-ef8c9aea1b45 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:49.777884 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:49.892761 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-9b8c6810-e118-48a1-9671-ef8c9aea1b45 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:49.902531 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-9b8c6810-e118-48a1-9671-ef8c9aea1b45 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:49.904003 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-9b8c6810-e118-48a1-9671-ef8c9aea1b45 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:49.905190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-9b8c6810-e118-48a1-9671-ef8c9aea1b45 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.159588 Sep 20 22:26:49.906036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 214/410] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:49 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:50.937779 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-fb82ac0d-ea29-430f-a8a1-2d36421656a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:50.938558 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-fb82ac0d-ea29-430f-a8a1-2d36421656a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:50.951124 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fb82ac0d-ea29-430f-a8a1-2d36421656a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:50.951936 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fb82ac0d-ea29-430f-a8a1-2d36421656a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:50.952483 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fb82ac0d-ea29-430f-a8a1-2d36421656a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:50.953224 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fb82ac0d-ea29-430f-a8a1-2d36421656a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:50.953687 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fb82ac0d-ea29-430f-a8a1-2d36421656a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:50.954116 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fb82ac0d-ea29-430f-a8a1-2d36421656a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:51.156373 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-fb82ac0d-ea29-430f-a8a1-2d36421656a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:51.165814 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-fb82ac0d-ea29-430f-a8a1-2d36421656a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:51.167434 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-fb82ac0d-ea29-430f-a8a1-2d36421656a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:51.168663 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-fb82ac0d-ea29-430f-a8a1-2d36421656a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.237853 Sep 20 22:26:51.169368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 197/411] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:50 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:52.195583 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-43fceaa4-c14e-4dc4-97e2-ef2286d6cec9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:52.196182 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-43fceaa4-c14e-4dc4-97e2-ef2286d6cec9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:52.207605 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-43fceaa4-c14e-4dc4-97e2-ef2286d6cec9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:52.210443 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-43fceaa4-c14e-4dc4-97e2-ef2286d6cec9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:52.211223 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-43fceaa4-c14e-4dc4-97e2-ef2286d6cec9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:52.212354 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-43fceaa4-c14e-4dc4-97e2-ef2286d6cec9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:52.212857 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-43fceaa4-c14e-4dc4-97e2-ef2286d6cec9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:52.213307 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-43fceaa4-c14e-4dc4-97e2-ef2286d6cec9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:52.390125 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-43fceaa4-c14e-4dc4-97e2-ef2286d6cec9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:52.406196 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-43fceaa4-c14e-4dc4-97e2-ef2286d6cec9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:52.434993 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-43fceaa4-c14e-4dc4-97e2-ef2286d6cec9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:52.445357 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-43fceaa4-c14e-4dc4-97e2-ef2286d6cec9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.253868 Sep 20 22:26:52.446422 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 215/412] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:52 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:53.474803 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-9909e1bb-a9a6-4d85-9efc-6c2926e4af05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:53.475469 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-9909e1bb-a9a6-4d85-9efc-6c2926e4af05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:53.482014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9909e1bb-a9a6-4d85-9efc-6c2926e4af05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:53.482497 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9909e1bb-a9a6-4d85-9efc-6c2926e4af05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:53.482928 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9909e1bb-a9a6-4d85-9efc-6c2926e4af05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:53.483626 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9909e1bb-a9a6-4d85-9efc-6c2926e4af05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:53.484072 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9909e1bb-a9a6-4d85-9efc-6c2926e4af05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:53.484490 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9909e1bb-a9a6-4d85-9efc-6c2926e4af05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:53.623517 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-9909e1bb-a9a6-4d85-9efc-6c2926e4af05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:53.633128 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-9909e1bb-a9a6-4d85-9efc-6c2926e4af05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:53.634626 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-9909e1bb-a9a6-4d85-9efc-6c2926e4af05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:53.635816 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-9909e1bb-a9a6-4d85-9efc-6c2926e4af05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.165006 Sep 20 22:26:53.636580 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 198/413] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:53 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:53.665710 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-10d43561-4462-4e44-ab7c-50a7a2eab556 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-391633267", "imageRef": "a1be001e-c2e4-44b7-b0d2-af96de3855c4", "flavorRef": "452", "networks": [{"uuid": "944b21fa-950f-457b-a018-244a7ad7e4ee"}]}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:26:53.731942 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.network.neutron [None req-10d43561-4462-4e44-ab7c-50a7a2eab556 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] validate_networks() for [('944b21fa-950f-457b-a018-244a7ad7e4ee', None, None, None, None, None)] {{(pid=120474) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:26:54.100258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-10d43561-4462-4e44-ab7c-50a7a2eab556 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Flavor limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:26:54.101287 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-10d43561-4462-4e44-ab7c-50a7a2eab556 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Image limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:26:54.102001 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-10d43561-4462-4e44-ab7c-50a7a2eab556 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Flavor pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:26:54.102827 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-10d43561-4462-4e44-ab7c-50a7a2eab556 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Image pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:26:54.103323 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-10d43561-4462-4e44-ab7c-50a7a2eab556 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:26:54.123978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-10d43561-4462-4e44-ab7c-50a7a2eab556 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:54.124456 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-10d43561-4462-4e44-ab7c-50a7a2eab556 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:54.124891 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-10d43561-4462-4e44-ab7c-50a7a2eab556 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:54.125690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-10d43561-4462-4e44-ab7c-50a7a2eab556 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:54.126205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-10d43561-4462-4e44-ab7c-50a7a2eab556 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:54.126632 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-10d43561-4462-4e44-ab7c-50a7a2eab556 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:54.150020 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-10d43561-4462-4e44-ab7c-50a7a2eab556 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Getting quotas for project bef004c556b540e28aafe07418fe8e30. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:26:54.154198 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-10d43561-4462-4e44-ab7c-50a7a2eab556 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Getting quotas for user 427aa58e5bb74f65afa75037c9e70f80 and project bef004c556b540e28aafe07418fe8e30. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:26:54.166086 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-10d43561-4462-4e44-ab7c-50a7a2eab556 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Going to run 1 instances... {{(pid=120474) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:26:54.168576 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-10d43561-4462-4e44-ab7c-50a7a2eab556 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a1be001e-c2e4-44b7-b0d2-af96de3855c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:26:54.218960 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-10d43561-4462-4e44-ab7c-50a7a2eab556 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559527 Sep 20 22:26:54.219883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 216/414] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:26:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 22:26:54.231073 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-10ecadcc-53a8-483c-9812-e09d506007cf tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:54.231823 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-10ecadcc-53a8-483c-9812-e09d506007cf tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:54.292552 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-10ecadcc-53a8-483c-9812-e09d506007cf tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:54.300052 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-10ecadcc-53a8-483c-9812-e09d506007cf tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1218 microversion: 2.1 time: 0.072916 Sep 20 22:26:54.300794 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 199/415] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:54 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:54.668463 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-6ef30648-769d-407e-a7bf-a5a9fa033ceb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:54.669493 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-6ef30648-769d-407e-a7bf-a5a9fa033ceb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:54.677755 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6ef30648-769d-407e-a7bf-a5a9fa033ceb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:54.679137 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6ef30648-769d-407e-a7bf-a5a9fa033ceb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:54.680334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6ef30648-769d-407e-a7bf-a5a9fa033ceb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:54.681280 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6ef30648-769d-407e-a7bf-a5a9fa033ceb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:54.683356 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6ef30648-769d-407e-a7bf-a5a9fa033ceb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:54.683972 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6ef30648-769d-407e-a7bf-a5a9fa033ceb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:54.823682 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6ef30648-769d-407e-a7bf-a5a9fa033ceb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:54.853425 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6ef30648-769d-407e-a7bf-a5a9fa033ceb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:54.855102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6ef30648-769d-407e-a7bf-a5a9fa033ceb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:54.856381 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-6ef30648-769d-407e-a7bf-a5a9fa033ceb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.191941 Sep 20 22:26:54.856983 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 217/416] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:54 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:26:55.324480 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-59b5c158-2e8d-4329-931e-353faa2f2016 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:55.325169 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-59b5c158-2e8d-4329-931e-353faa2f2016 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:55.340531 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-59b5c158-2e8d-4329-931e-353faa2f2016 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:55.341071 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-59b5c158-2e8d-4329-931e-353faa2f2016 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:55.341526 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-59b5c158-2e8d-4329-931e-353faa2f2016 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:55.342384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-59b5c158-2e8d-4329-931e-353faa2f2016 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:55.342852 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-59b5c158-2e8d-4329-931e-353faa2f2016 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:55.343281 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-59b5c158-2e8d-4329-931e-353faa2f2016 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:55.412964 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-59b5c158-2e8d-4329-931e-353faa2f2016 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:55.421311 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-59b5c158-2e8d-4329-931e-353faa2f2016 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1222 microversion: 2.1 time: 0.100880 Sep 20 22:26:55.425018 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 200/417] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:55 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:55.885978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-0dbfb481-6220-4b13-9836-e343796a3e4a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:55.887340 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-0dbfb481-6220-4b13-9836-e343796a3e4a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:55.895366 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0dbfb481-6220-4b13-9836-e343796a3e4a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:55.896340 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0dbfb481-6220-4b13-9836-e343796a3e4a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:55.897039 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0dbfb481-6220-4b13-9836-e343796a3e4a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:55.898078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0dbfb481-6220-4b13-9836-e343796a3e4a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:55.898529 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0dbfb481-6220-4b13-9836-e343796a3e4a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:55.898955 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0dbfb481-6220-4b13-9836-e343796a3e4a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:56.030851 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-0dbfb481-6220-4b13-9836-e343796a3e4a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:56.039488 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-0dbfb481-6220-4b13-9836-e343796a3e4a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:56.040936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-0dbfb481-6220-4b13-9836-e343796a3e4a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:56.042116 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-0dbfb481-6220-4b13-9836-e343796a3e4a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.160937 Sep 20 22:26:56.042769 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 218/418] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:55 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:56.443777 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-2948d961-ae7a-4806-8519-36e6831e1ef3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:56.444468 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-2948d961-ae7a-4806-8519-36e6831e1ef3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:56.451052 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2948d961-ae7a-4806-8519-36e6831e1ef3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:56.451533 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2948d961-ae7a-4806-8519-36e6831e1ef3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:56.451966 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2948d961-ae7a-4806-8519-36e6831e1ef3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:56.452665 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2948d961-ae7a-4806-8519-36e6831e1ef3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:56.453157 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2948d961-ae7a-4806-8519-36e6831e1ef3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:56.453578 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2948d961-ae7a-4806-8519-36e6831e1ef3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:56.513610 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-2948d961-ae7a-4806-8519-36e6831e1ef3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:56.521309 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-2948d961-ae7a-4806-8519-36e6831e1ef3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1222 microversion: 2.1 time: 0.081371 Sep 20 22:26:56.521912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 201/419] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:56 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:57.077845 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-17b25fea-9e8c-4251-851b-33b46c3b10a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:57.078412 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-17b25fea-9e8c-4251-851b-33b46c3b10a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:57.085637 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-17b25fea-9e8c-4251-851b-33b46c3b10a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:57.086372 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-17b25fea-9e8c-4251-851b-33b46c3b10a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:57.086953 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-17b25fea-9e8c-4251-851b-33b46c3b10a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:57.087798 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-17b25fea-9e8c-4251-851b-33b46c3b10a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:57.088402 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-17b25fea-9e8c-4251-851b-33b46c3b10a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:57.088956 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-17b25fea-9e8c-4251-851b-33b46c3b10a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:57.223317 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-17b25fea-9e8c-4251-851b-33b46c3b10a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:57.232274 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-17b25fea-9e8c-4251-851b-33b46c3b10a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:57.233747 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-17b25fea-9e8c-4251-851b-33b46c3b10a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:57.234890 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-17b25fea-9e8c-4251-851b-33b46c3b10a6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.161020 Sep 20 22:26:57.235454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 219/420] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:57 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:57.544287 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-5ccbe2c0-5e09-465b-b0a6-bc337e5d9505 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:57.544915 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-5ccbe2c0-5e09-465b-b0a6-bc337e5d9505 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:57.551296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5ccbe2c0-5e09-465b-b0a6-bc337e5d9505 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:57.551778 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5ccbe2c0-5e09-465b-b0a6-bc337e5d9505 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:57.552214 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5ccbe2c0-5e09-465b-b0a6-bc337e5d9505 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:57.552937 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5ccbe2c0-5e09-465b-b0a6-bc337e5d9505 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:57.553426 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5ccbe2c0-5e09-465b-b0a6-bc337e5d9505 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:57.553851 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5ccbe2c0-5e09-465b-b0a6-bc337e5d9505 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:57.614451 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-5ccbe2c0-5e09-465b-b0a6-bc337e5d9505 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:57.622386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-5ccbe2c0-5e09-465b-b0a6-bc337e5d9505 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1222 microversion: 2.1 time: 0.081942 Sep 20 22:26:57.622942 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 202/421] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:57 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:26:58.261857 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-039630cf-b447-4090-b511-64f3405adb94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:58.262476 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-039630cf-b447-4090-b511-64f3405adb94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:58.268870 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-039630cf-b447-4090-b511-64f3405adb94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:58.269346 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-039630cf-b447-4090-b511-64f3405adb94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:58.269774 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-039630cf-b447-4090-b511-64f3405adb94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:58.270448 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-039630cf-b447-4090-b511-64f3405adb94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:58.270893 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-039630cf-b447-4090-b511-64f3405adb94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:58.271306 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-039630cf-b447-4090-b511-64f3405adb94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:58.400598 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-039630cf-b447-4090-b511-64f3405adb94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:58.409380 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-039630cf-b447-4090-b511-64f3405adb94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:58.411445 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-039630cf-b447-4090-b511-64f3405adb94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:58.413539 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-039630cf-b447-4090-b511-64f3405adb94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.155308 Sep 20 22:26:58.414498 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 220/422] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:58 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:58.643577 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-2974b63d-4be3-4717-b216-45179e88d9ef tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:58.644191 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-2974b63d-4be3-4717-b216-45179e88d9ef tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:58.650545 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2974b63d-4be3-4717-b216-45179e88d9ef tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:58.651025 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2974b63d-4be3-4717-b216-45179e88d9ef tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:58.651489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2974b63d-4be3-4717-b216-45179e88d9ef tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:58.652173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2974b63d-4be3-4717-b216-45179e88d9ef tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:58.652623 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2974b63d-4be3-4717-b216-45179e88d9ef tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:58.653077 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2974b63d-4be3-4717-b216-45179e88d9ef tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:58.714559 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-2974b63d-4be3-4717-b216-45179e88d9ef tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:58.722154 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-2974b63d-4be3-4717-b216-45179e88d9ef tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1222 microversion: 2.1 time: 0.082425 Sep 20 22:26:58.722716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 203/423] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:58 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:26:59.446466 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3ebed768-120b-4a16-a27e-46aaf1564fd4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:59.447079 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-3ebed768-120b-4a16-a27e-46aaf1564fd4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:59.453488 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3ebed768-120b-4a16-a27e-46aaf1564fd4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:59.453964 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3ebed768-120b-4a16-a27e-46aaf1564fd4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:59.454395 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3ebed768-120b-4a16-a27e-46aaf1564fd4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:59.455080 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3ebed768-120b-4a16-a27e-46aaf1564fd4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:59.455533 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3ebed768-120b-4a16-a27e-46aaf1564fd4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:59.455961 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3ebed768-120b-4a16-a27e-46aaf1564fd4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:59.601906 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3ebed768-120b-4a16-a27e-46aaf1564fd4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:59.617858 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3ebed768-120b-4a16-a27e-46aaf1564fd4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:59.619801 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3ebed768-120b-4a16-a27e-46aaf1564fd4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:59.621311 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-3ebed768-120b-4a16-a27e-46aaf1564fd4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.179062 Sep 20 22:26:59.622011 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 221/424] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:26:59 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:26:59.745127 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-128cd38e-fbc4-4fee-9d53-3fee5778855a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:26:59.745721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-128cd38e-fbc4-4fee-9d53-3fee5778855a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:26:59.752076 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-128cd38e-fbc4-4fee-9d53-3fee5778855a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:59.752577 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-128cd38e-fbc4-4fee-9d53-3fee5778855a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:59.752999 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-128cd38e-fbc4-4fee-9d53-3fee5778855a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:59.753699 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-128cd38e-fbc4-4fee-9d53-3fee5778855a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:26:59.754147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-128cd38e-fbc4-4fee-9d53-3fee5778855a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:26:59.754563 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-128cd38e-fbc4-4fee-9d53-3fee5778855a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:26:59.816779 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-128cd38e-fbc4-4fee-9d53-3fee5778855a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:26:59.825080 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-128cd38e-fbc4-4fee-9d53-3fee5778855a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1222 microversion: 2.1 time: 0.084295 Sep 20 22:26:59.825650 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 204/425] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:26:59 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:00.648530 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4881a10b-8a54-4d00-b365-aa80f07ccb17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:00.649156 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4881a10b-8a54-4d00-b365-aa80f07ccb17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:00.655522 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4881a10b-8a54-4d00-b365-aa80f07ccb17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:00.656002 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4881a10b-8a54-4d00-b365-aa80f07ccb17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:00.656431 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4881a10b-8a54-4d00-b365-aa80f07ccb17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:00.657164 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4881a10b-8a54-4d00-b365-aa80f07ccb17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:00.657616 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4881a10b-8a54-4d00-b365-aa80f07ccb17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:00.658035 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4881a10b-8a54-4d00-b365-aa80f07ccb17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:00.786582 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4881a10b-8a54-4d00-b365-aa80f07ccb17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:00.795441 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4881a10b-8a54-4d00-b365-aa80f07ccb17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:00.796886 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4881a10b-8a54-4d00-b365-aa80f07ccb17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:00.798066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4881a10b-8a54-4d00-b365-aa80f07ccb17 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.154316 Sep 20 22:27:00.798622 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 222/426] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:27:00 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:27:00.847406 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a665a34c-1b5f-43d1-9308-7516ce7533b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:00.848010 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a665a34c-1b5f-43d1-9308-7516ce7533b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:00.854475 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a665a34c-1b5f-43d1-9308-7516ce7533b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:00.854951 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a665a34c-1b5f-43d1-9308-7516ce7533b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:00.856485 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a665a34c-1b5f-43d1-9308-7516ce7533b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:00.857211 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a665a34c-1b5f-43d1-9308-7516ce7533b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:00.857661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a665a34c-1b5f-43d1-9308-7516ce7533b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:00.858078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a665a34c-1b5f-43d1-9308-7516ce7533b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:00.919630 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a665a34c-1b5f-43d1-9308-7516ce7533b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:00.927098 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a665a34c-1b5f-43d1-9308-7516ce7533b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1222 microversion: 2.1 time: 0.083476 Sep 20 22:27:00.927657 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 205/427] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:00 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:01.823530 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-2fd2420b-3fec-478d-887b-847648817ea6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:01.824071 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-2fd2420b-3fec-478d-887b-847648817ea6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:01.830381 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2fd2420b-3fec-478d-887b-847648817ea6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:01.830854 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2fd2420b-3fec-478d-887b-847648817ea6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:01.831281 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2fd2420b-3fec-478d-887b-847648817ea6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:01.831956 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2fd2420b-3fec-478d-887b-847648817ea6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:01.832402 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2fd2420b-3fec-478d-887b-847648817ea6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:01.832818 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2fd2420b-3fec-478d-887b-847648817ea6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:01.949540 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-2c16c932-c094-4a8c-b48d-79a16ea16ca3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:01.950147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-2c16c932-c094-4a8c-b48d-79a16ea16ca3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:01.956501 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2c16c932-c094-4a8c-b48d-79a16ea16ca3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:01.956998 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2c16c932-c094-4a8c-b48d-79a16ea16ca3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:01.957432 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2c16c932-c094-4a8c-b48d-79a16ea16ca3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:01.958155 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2c16c932-c094-4a8c-b48d-79a16ea16ca3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:01.958678 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2c16c932-c094-4a8c-b48d-79a16ea16ca3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:01.959591 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2c16c932-c094-4a8c-b48d-79a16ea16ca3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:01.961320 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-2fd2420b-3fec-478d-887b-847648817ea6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:01.969846 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-2fd2420b-3fec-478d-887b-847648817ea6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:01.971328 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-2fd2420b-3fec-478d-887b-847648817ea6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:01.972482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-2fd2420b-3fec-478d-887b-847648817ea6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.152990 Sep 20 22:27:01.973067 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 223/428] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:27:01 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:27:02.019925 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-2c16c932-c094-4a8c-b48d-79a16ea16ca3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:02.028021 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-2c16c932-c094-4a8c-b48d-79a16ea16ca3 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1222 microversion: 2.1 time: 0.082427 Sep 20 22:27:02.028588 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 206/429] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:01 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:27:02.698024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-1d5e828a-b224-4514-93cf-91e4d8ece369 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:02.698516 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-1d5e828a-b224-4514-93cf-91e4d8ece369 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:02.704454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1d5e828a-b224-4514-93cf-91e4d8ece369 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:02.704937 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1d5e828a-b224-4514-93cf-91e4d8ece369 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:02.705405 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1d5e828a-b224-4514-93cf-91e4d8ece369 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:02.706089 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1d5e828a-b224-4514-93cf-91e4d8ece369 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:02.706540 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1d5e828a-b224-4514-93cf-91e4d8ece369 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:02.706962 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1d5e828a-b224-4514-93cf-91e4d8ece369 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:02.831232 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-1d5e828a-b224-4514-93cf-91e4d8ece369 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lazy-loading 'services' on Instance uuid 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:27:02.952373 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-1d5e828a-b224-4514-93cf-91e4d8ece369 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "DELETE /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0/os-volume_attachments/89ae9b1f-da21-4d79-89e6-ae8fcbdd23a9" status: 202 len: 0 microversion: 2.1 time: 0.258705 Sep 20 22:27:02.953096 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 224/430] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 20 22:27:02 2022] DELETE /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0/os-volume_attachments/89ae9b1f-da21-4d79-89e6-ae8fcbdd23a9 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:27:02.998949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-dfb6ce02-ec93-475c-aa59-69a4a6f6b7d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:02.999610 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-dfb6ce02-ec93-475c-aa59-69a4a6f6b7d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:03.008049 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dfb6ce02-ec93-475c-aa59-69a4a6f6b7d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:03.008602 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dfb6ce02-ec93-475c-aa59-69a4a6f6b7d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:03.008996 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dfb6ce02-ec93-475c-aa59-69a4a6f6b7d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:03.009687 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dfb6ce02-ec93-475c-aa59-69a4a6f6b7d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:03.010135 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dfb6ce02-ec93-475c-aa59-69a4a6f6b7d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:03.010552 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dfb6ce02-ec93-475c-aa59-69a4a6f6b7d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:03.052823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-692a2270-a033-4c55-9bb0-01663fc95a0b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:03.054492 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-692a2270-a033-4c55-9bb0-01663fc95a0b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:03.068536 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-692a2270-a033-4c55-9bb0-01663fc95a0b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:03.069095 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-692a2270-a033-4c55-9bb0-01663fc95a0b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:03.069573 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-692a2270-a033-4c55-9bb0-01663fc95a0b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:03.070375 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-692a2270-a033-4c55-9bb0-01663fc95a0b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:03.070911 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-692a2270-a033-4c55-9bb0-01663fc95a0b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:03.071339 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-692a2270-a033-4c55-9bb0-01663fc95a0b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:03.135176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-692a2270-a033-4c55-9bb0-01663fc95a0b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:03.142738 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-692a2270-a033-4c55-9bb0-01663fc95a0b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1270 microversion: 2.1 time: 0.095479 Sep 20 22:27:03.143301 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 225/431] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:03 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:03.156445 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-dfb6ce02-ec93-475c-aa59-69a4a6f6b7d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:03.165454 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-dfb6ce02-ec93-475c-aa59-69a4a6f6b7d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:03.166900 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-dfb6ce02-ec93-475c-aa59-69a4a6f6b7d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:03.168080 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-dfb6ce02-ec93-475c-aa59-69a4a6f6b7d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.173610 Sep 20 22:27:03.168628 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 207/432] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:27:02 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:27:04.086895 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-7cd45219-caf3-4cce-85aa-202ffc262682 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:27:04.093277 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7cd45219-caf3-4cce-85aa-202ffc262682 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:04.093762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7cd45219-caf3-4cce-85aa-202ffc262682 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:04.094196 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7cd45219-caf3-4cce-85aa-202ffc262682 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:04.117045 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-7cd45219-caf3-4cce-85aa-202ffc262682 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Going to try to stop instance {{(pid=120474) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 20 22:27:04.135033 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=2 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:04.159253 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-7cd45219-caf3-4cce-85aa-202ffc262682 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "POST /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0/action" status: 202 len: 0 microversion: 2.1 time: 0.076731 Sep 20 22:27:04.159856 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 226/433] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 20 22:27:04 2022] POST /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:27:04.164837 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=6 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:04.165807 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-4f509b6b-5d83-4d6c-8c0f-ba6865c1a55e tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:04.166505 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-4f509b6b-5d83-4d6c-8c0f-ba6865c1a55e tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:04.168883 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 20 22:27:04.169033 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-eb04998f-d761-4cc5-80bb-372bc323cdb5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:04.169162 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Tue Sep 20 22:27:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 (ip 10.222.0.16) !!! Sep 20 22:27:04.169716 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-eb04998f-d761-4cc5-80bb-372bc323cdb5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:04.176161 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eb04998f-d761-4cc5-80bb-372bc323cdb5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:04.176654 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eb04998f-d761-4cc5-80bb-372bc323cdb5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:04.177125 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eb04998f-d761-4cc5-80bb-372bc323cdb5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:04.178365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eb04998f-d761-4cc5-80bb-372bc323cdb5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:04.178822 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eb04998f-d761-4cc5-80bb-372bc323cdb5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:04.179246 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eb04998f-d761-4cc5-80bb-372bc323cdb5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:04.181807 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4f509b6b-5d83-4d6c-8c0f-ba6865c1a55e tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:04.182290 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4f509b6b-5d83-4d6c-8c0f-ba6865c1a55e tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:04.182722 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4f509b6b-5d83-4d6c-8c0f-ba6865c1a55e tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:04.183412 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4f509b6b-5d83-4d6c-8c0f-ba6865c1a55e tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:04.183863 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4f509b6b-5d83-4d6c-8c0f-ba6865c1a55e tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:04.184283 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4f509b6b-5d83-4d6c-8c0f-ba6865c1a55e tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:04.245035 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-4f509b6b-5d83-4d6c-8c0f-ba6865c1a55e tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:04.253135 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-4f509b6b-5d83-4d6c-8c0f-ba6865c1a55e tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1278 microversion: 2.1 time: 0.091223 Sep 20 22:27:04.253701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 208/434] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:04 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1278 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:04.266507 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0fad9d5d-afe7-487d-9ea2-08f509d4a86e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:04.272498 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-0fad9d5d-afe7-487d-9ea2-08f509d4a86e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:04.289509 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0fad9d5d-afe7-487d-9ea2-08f509d4a86e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:04.289963 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0fad9d5d-afe7-487d-9ea2-08f509d4a86e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:04.290561 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0fad9d5d-afe7-487d-9ea2-08f509d4a86e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:04.291844 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0fad9d5d-afe7-487d-9ea2-08f509d4a86e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:04.292668 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0fad9d5d-afe7-487d-9ea2-08f509d4a86e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:04.293325 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0fad9d5d-afe7-487d-9ea2-08f509d4a86e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:04.299979 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=2 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:04.322860 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-eb04998f-d761-4cc5-80bb-372bc323cdb5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:04.333758 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-eb04998f-d761-4cc5-80bb-372bc323cdb5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1677 microversion: 2.1 time: 0.169427 Sep 20 22:27:04.349003 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 227/435] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:04 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:04.483130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-0fad9d5d-afe7-487d-9ea2-08f509d4a86e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:04.492871 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-0fad9d5d-afe7-487d-9ea2-08f509d4a86e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:04.494410 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-0fad9d5d-afe7-487d-9ea2-08f509d4a86e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:04.495576 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-0fad9d5d-afe7-487d-9ea2-08f509d4a86e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.240958 Sep 20 22:27:04.496142 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 209/436] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:27:04 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:27:05.276988 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-6b42d180-9ea6-4860-9d18-7186122f33b7 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:05.277622 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-6b42d180-9ea6-4860-9d18-7186122f33b7 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:05.283973 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6b42d180-9ea6-4860-9d18-7186122f33b7 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:05.284453 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6b42d180-9ea6-4860-9d18-7186122f33b7 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:05.284889 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6b42d180-9ea6-4860-9d18-7186122f33b7 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:05.285666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6b42d180-9ea6-4860-9d18-7186122f33b7 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:05.286113 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6b42d180-9ea6-4860-9d18-7186122f33b7 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:05.286528 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6b42d180-9ea6-4860-9d18-7186122f33b7 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:05.357629 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-56b3ea24-16f7-4b82-b738-7503d44181bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:05.358829 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-56b3ea24-16f7-4b82-b738-7503d44181bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:05.366494 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56b3ea24-16f7-4b82-b738-7503d44181bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:05.367042 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56b3ea24-16f7-4b82-b738-7503d44181bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:05.367488 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56b3ea24-16f7-4b82-b738-7503d44181bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:05.368187 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56b3ea24-16f7-4b82-b738-7503d44181bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:05.368859 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56b3ea24-16f7-4b82-b738-7503d44181bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:05.369347 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56b3ea24-16f7-4b82-b738-7503d44181bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:05.425609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6b42d180-9ea6-4860-9d18-7186122f33b7 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:05.433831 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-6b42d180-9ea6-4860-9d18-7186122f33b7 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1318 microversion: 2.1 time: 0.160815 Sep 20 22:27:05.434417 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 228/437] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:05 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:05.522258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b71e8e69-9957-4f65-80c1-20e443b455d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:05.522966 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b71e8e69-9957-4f65-80c1-20e443b455d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:05.529038 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b71e8e69-9957-4f65-80c1-20e443b455d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:05.529530 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b71e8e69-9957-4f65-80c1-20e443b455d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:05.529964 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b71e8e69-9957-4f65-80c1-20e443b455d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:05.530655 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b71e8e69-9957-4f65-80c1-20e443b455d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:05.531111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b71e8e69-9957-4f65-80c1-20e443b455d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:05.531529 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b71e8e69-9957-4f65-80c1-20e443b455d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:05.562098 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-56b3ea24-16f7-4b82-b738-7503d44181bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:05.570279 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-56b3ea24-16f7-4b82-b738-7503d44181bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1677 microversion: 2.1 time: 0.216704 Sep 20 22:27:05.581207 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 210/438] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:05 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1677 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:27:05.672570 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b71e8e69-9957-4f65-80c1-20e443b455d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:05.681293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b71e8e69-9957-4f65-80c1-20e443b455d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:05.682780 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b71e8e69-9957-4f65-80c1-20e443b455d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:05.683931 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b71e8e69-9957-4f65-80c1-20e443b455d4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.165707 Sep 20 22:27:05.684489 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 229/439] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:27:05 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:27:05.852993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-0d068e99-a59e-4f0b-a1a3-c4afa22561a1 req-7e803ecb-2444-4933-b5a2-f742071eb38a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78d574ff-9ba0-4414-9527-4348b7f319b1", "tag": "9d9ce120-05ea-4d90-a0c6-fe7b78bb0049"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:27:05.858915 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:05.866691 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-0d068e99-a59e-4f0b-a1a3-c4afa22561a1 req-7e803ecb-2444-4933-b5a2-f742071eb38a service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:05.867804 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-0d068e99-a59e-4f0b-a1a3-c4afa22561a1 req-7e803ecb-2444-4933-b5a2-f742071eb38a service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:05.868250 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-0d068e99-a59e-4f0b-a1a3-c4afa22561a1 req-7e803ecb-2444-4933-b5a2-f742071eb38a service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:05.882777 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-0d068e99-a59e-4f0b-a1a3-c4afa22561a1 req-7e803ecb-2444-4933-b5a2-f742071eb38a service nova] Creating event network-changed:9d9ce120-05ea-4d90-a0c6-fe7b78bb0049 for instance 78d574ff-9ba0-4414-9527-4348b7f319b1 on hv-cinder-85827 Sep 20 22:27:05.888124 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-0d068e99-a59e-4f0b-a1a3-c4afa22561a1 req-7e803ecb-2444-4933-b5a2-f742071eb38a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039557 Sep 20 22:27:05.888739 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 211/440] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:27:06.457089 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-33beaf61-209a-4a9e-82f7-0f2ca6c4dea4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:06.457669 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-33beaf61-209a-4a9e-82f7-0f2ca6c4dea4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:06.463954 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-33beaf61-209a-4a9e-82f7-0f2ca6c4dea4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:06.464429 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-33beaf61-209a-4a9e-82f7-0f2ca6c4dea4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:06.464862 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-33beaf61-209a-4a9e-82f7-0f2ca6c4dea4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:06.465563 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-33beaf61-209a-4a9e-82f7-0f2ca6c4dea4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:06.466011 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-33beaf61-209a-4a9e-82f7-0f2ca6c4dea4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:06.466428 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-33beaf61-209a-4a9e-82f7-0f2ca6c4dea4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:06.470350 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:06.595175 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ea02609a-5262-4548-ada9-1925f8f14cf0 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:06.595880 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ea02609a-5262-4548-ada9-1925f8f14cf0 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:06.596305 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-33beaf61-209a-4a9e-82f7-0f2ca6c4dea4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:06.602006 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ea02609a-5262-4548-ada9-1925f8f14cf0 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:06.602490 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ea02609a-5262-4548-ada9-1925f8f14cf0 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:06.602926 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ea02609a-5262-4548-ada9-1925f8f14cf0 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:06.603623 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ea02609a-5262-4548-ada9-1925f8f14cf0 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:06.604077 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ea02609a-5262-4548-ada9-1925f8f14cf0 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:06.604177 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-33beaf61-209a-4a9e-82f7-0f2ca6c4dea4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1318 microversion: 2.1 time: 0.150951 Sep 20 22:27:06.604520 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ea02609a-5262-4548-ada9-1925f8f14cf0 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:06.612403 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 230/441] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:06 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:06.709558 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a167c49e-f415-4391-953e-0b04dd29cb77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:06.710204 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a167c49e-f415-4391-953e-0b04dd29cb77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:06.716333 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a167c49e-f415-4391-953e-0b04dd29cb77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:06.716822 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a167c49e-f415-4391-953e-0b04dd29cb77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:06.717490 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a167c49e-f415-4391-953e-0b04dd29cb77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:06.718223 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a167c49e-f415-4391-953e-0b04dd29cb77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:06.718704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a167c49e-f415-4391-953e-0b04dd29cb77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:06.719159 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a167c49e-f415-4391-953e-0b04dd29cb77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:06.732961 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ea02609a-5262-4548-ada9-1925f8f14cf0 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:06.741527 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ea02609a-5262-4548-ada9-1925f8f14cf0 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1677 microversion: 2.1 time: 0.150913 Sep 20 22:27:06.742096 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 212/442] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:06 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:27:06.854756 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a167c49e-f415-4391-953e-0b04dd29cb77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:06.863211 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a167c49e-f415-4391-953e-0b04dd29cb77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:06.864657 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a167c49e-f415-4391-953e-0b04dd29cb77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:06.866762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a167c49e-f415-4391-953e-0b04dd29cb77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.161547 Sep 20 22:27:06.867307 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 231/443] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:27:06 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:27:07.629315 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-275e2ae7-1236-45df-beea-72564d26077c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:07.629942 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-275e2ae7-1236-45df-beea-72564d26077c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:07.636641 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-275e2ae7-1236-45df-beea-72564d26077c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:07.637169 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-275e2ae7-1236-45df-beea-72564d26077c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:07.637843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-275e2ae7-1236-45df-beea-72564d26077c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:07.638311 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-275e2ae7-1236-45df-beea-72564d26077c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:07.638793 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-275e2ae7-1236-45df-beea-72564d26077c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:07.639218 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-275e2ae7-1236-45df-beea-72564d26077c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:07.765341 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-069776f8-aa8f-4e72-932a-62dfd1957e4a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:07.765948 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-069776f8-aa8f-4e72-932a-62dfd1957e4a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:07.772222 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-069776f8-aa8f-4e72-932a-62dfd1957e4a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:07.772703 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-069776f8-aa8f-4e72-932a-62dfd1957e4a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:07.773167 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-069776f8-aa8f-4e72-932a-62dfd1957e4a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:07.773853 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-069776f8-aa8f-4e72-932a-62dfd1957e4a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:07.774302 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-069776f8-aa8f-4e72-932a-62dfd1957e4a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:07.774718 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-069776f8-aa8f-4e72-932a-62dfd1957e4a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:07.875511 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-275e2ae7-1236-45df-beea-72564d26077c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:07.877841 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=100 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:07.884762 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-275e2ae7-1236-45df-beea-72564d26077c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1318 microversion: 2.1 time: 0.260776 Sep 20 22:27:07.886684 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 213/444] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:07 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:07.891605 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-7b135b79-816c-420d-8cae-50da22d318a7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:07.892217 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-7b135b79-816c-420d-8cae-50da22d318a7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:07.898850 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7b135b79-816c-420d-8cae-50da22d318a7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:07.899378 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7b135b79-816c-420d-8cae-50da22d318a7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:07.899800 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7b135b79-816c-420d-8cae-50da22d318a7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:07.900497 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7b135b79-816c-420d-8cae-50da22d318a7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:07.900949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7b135b79-816c-420d-8cae-50da22d318a7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:07.901401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7b135b79-816c-420d-8cae-50da22d318a7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:07.906441 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-069776f8-aa8f-4e72-932a-62dfd1957e4a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:07.914702 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-069776f8-aa8f-4e72-932a-62dfd1957e4a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1677 microversion: 2.1 time: 0.153162 Sep 20 22:27:07.915264 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 232/445] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:07 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:27:08.064119 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-7b135b79-816c-420d-8cae-50da22d318a7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:08.072565 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-7b135b79-816c-420d-8cae-50da22d318a7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:08.074058 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-7b135b79-816c-420d-8cae-50da22d318a7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:08.075212 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-7b135b79-816c-420d-8cae-50da22d318a7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.187567 Sep 20 22:27:08.075766 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 214/446] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:27:07 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:27:08.907642 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-180de0ac-5da6-47b5-ad0d-07768044286c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:08.908286 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-180de0ac-5da6-47b5-ad0d-07768044286c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:08.914726 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-180de0ac-5da6-47b5-ad0d-07768044286c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:08.915211 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-180de0ac-5da6-47b5-ad0d-07768044286c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:08.915646 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-180de0ac-5da6-47b5-ad0d-07768044286c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:08.916336 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-180de0ac-5da6-47b5-ad0d-07768044286c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:08.916784 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-180de0ac-5da6-47b5-ad0d-07768044286c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:08.917239 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-180de0ac-5da6-47b5-ad0d-07768044286c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:08.937695 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-727791ee-6719-476e-b43c-25bef16be73e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:08.938336 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-727791ee-6719-476e-b43c-25bef16be73e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:08.945303 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-727791ee-6719-476e-b43c-25bef16be73e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:08.945778 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-727791ee-6719-476e-b43c-25bef16be73e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:08.946211 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-727791ee-6719-476e-b43c-25bef16be73e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:08.946899 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-727791ee-6719-476e-b43c-25bef16be73e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:08.947350 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-727791ee-6719-476e-b43c-25bef16be73e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:08.947765 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-727791ee-6719-476e-b43c-25bef16be73e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:09.050040 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-180de0ac-5da6-47b5-ad0d-07768044286c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:09.058552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-180de0ac-5da6-47b5-ad0d-07768044286c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1318 microversion: 2.1 time: 0.154688 Sep 20 22:27:09.059204 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 233/447] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:08 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:09.102907 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-fbefae8c-0929-40f3-a62d-a15cc9d07652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:09.103578 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-fbefae8c-0929-40f3-a62d-a15cc9d07652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:09.109725 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fbefae8c-0929-40f3-a62d-a15cc9d07652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:09.110239 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fbefae8c-0929-40f3-a62d-a15cc9d07652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:09.110704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fbefae8c-0929-40f3-a62d-a15cc9d07652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:09.111440 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fbefae8c-0929-40f3-a62d-a15cc9d07652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:09.111899 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fbefae8c-0929-40f3-a62d-a15cc9d07652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:09.112391 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fbefae8c-0929-40f3-a62d-a15cc9d07652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:09.166462 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-727791ee-6719-476e-b43c-25bef16be73e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:09.174576 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-727791ee-6719-476e-b43c-25bef16be73e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1677 microversion: 2.1 time: 0.240658 Sep 20 22:27:09.175241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 215/448] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:08 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1677 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:27:09.244153 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-fbefae8c-0929-40f3-a62d-a15cc9d07652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:09.254109 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-fbefae8c-0929-40f3-a62d-a15cc9d07652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:09.256147 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-fbefae8c-0929-40f3-a62d-a15cc9d07652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:09.257376 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-fbefae8c-0929-40f3-a62d-a15cc9d07652 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.159376 Sep 20 22:27:09.257935 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 234/449] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:27:09 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:27:10.081413 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-3ed55fad-ac56-4476-9c5a-13906abe2b0a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:10.082020 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-3ed55fad-ac56-4476-9c5a-13906abe2b0a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:10.089220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3ed55fad-ac56-4476-9c5a-13906abe2b0a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:10.089699 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3ed55fad-ac56-4476-9c5a-13906abe2b0a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:10.090131 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3ed55fad-ac56-4476-9c5a-13906abe2b0a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:10.090857 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3ed55fad-ac56-4476-9c5a-13906abe2b0a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:10.091296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3ed55fad-ac56-4476-9c5a-13906abe2b0a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:10.091707 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3ed55fad-ac56-4476-9c5a-13906abe2b0a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:10.200081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-20884e7f-79f5-42ea-8583-d57b793ed234 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:10.200688 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-20884e7f-79f5-42ea-8583-d57b793ed234 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:10.211272 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-20884e7f-79f5-42ea-8583-d57b793ed234 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:10.211787 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-20884e7f-79f5-42ea-8583-d57b793ed234 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:10.212222 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-20884e7f-79f5-42ea-8583-d57b793ed234 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:10.212934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-20884e7f-79f5-42ea-8583-d57b793ed234 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:10.213416 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-20884e7f-79f5-42ea-8583-d57b793ed234 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:10.213836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-20884e7f-79f5-42ea-8583-d57b793ed234 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:10.226268 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-3ed55fad-ac56-4476-9c5a-13906abe2b0a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:10.236338 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-3ed55fad-ac56-4476-9c5a-13906abe2b0a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1318 microversion: 2.1 time: 0.158809 Sep 20 22:27:10.238243 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 216/450] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:10 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:10.283663 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-16a1c89d-d8fd-45c5-af10-f4aa50eb360b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:10.284987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-16a1c89d-d8fd-45c5-af10-f4aa50eb360b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:10.290130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-16a1c89d-d8fd-45c5-af10-f4aa50eb360b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:10.290620 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-16a1c89d-d8fd-45c5-af10-f4aa50eb360b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:10.291051 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-16a1c89d-d8fd-45c5-af10-f4aa50eb360b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:10.291752 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-16a1c89d-d8fd-45c5-af10-f4aa50eb360b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:10.292202 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-16a1c89d-d8fd-45c5-af10-f4aa50eb360b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:10.292625 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-16a1c89d-d8fd-45c5-af10-f4aa50eb360b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:10.352872 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-20884e7f-79f5-42ea-8583-d57b793ed234 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:10.361355 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-20884e7f-79f5-42ea-8583-d57b793ed234 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1677 microversion: 2.1 time: 0.165010 Sep 20 22:27:10.362224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 235/451] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:10 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:27:10.428744 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-16a1c89d-d8fd-45c5-af10-f4aa50eb360b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:10.437456 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-16a1c89d-d8fd-45c5-af10-f4aa50eb360b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:10.438909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-16a1c89d-d8fd-45c5-af10-f4aa50eb360b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:10.440053 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-16a1c89d-d8fd-45c5-af10-f4aa50eb360b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.160244 Sep 20 22:27:10.440610 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 217/452] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:27:10 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:27:11.260234 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c34681a5-c8f7-4c31-885c-db82bc1fa9b4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:11.260851 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-c34681a5-c8f7-4c31-885c-db82bc1fa9b4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:11.267228 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c34681a5-c8f7-4c31-885c-db82bc1fa9b4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:11.267710 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c34681a5-c8f7-4c31-885c-db82bc1fa9b4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:11.268144 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c34681a5-c8f7-4c31-885c-db82bc1fa9b4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:11.268833 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c34681a5-c8f7-4c31-885c-db82bc1fa9b4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:11.269385 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c34681a5-c8f7-4c31-885c-db82bc1fa9b4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:11.269816 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c34681a5-c8f7-4c31-885c-db82bc1fa9b4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:11.385686 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-4ab88c60-b31a-4565-a3a6-c0f03b6fc34a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:11.386307 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-4ab88c60-b31a-4565-a3a6-c0f03b6fc34a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:11.393054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ab88c60-b31a-4565-a3a6-c0f03b6fc34a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:11.393540 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ab88c60-b31a-4565-a3a6-c0f03b6fc34a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:11.393971 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ab88c60-b31a-4565-a3a6-c0f03b6fc34a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:11.394659 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ab88c60-b31a-4565-a3a6-c0f03b6fc34a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:11.395108 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ab88c60-b31a-4565-a3a6-c0f03b6fc34a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:11.395524 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ab88c60-b31a-4565-a3a6-c0f03b6fc34a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:11.395777 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-c34681a5-c8f7-4c31-885c-db82bc1fa9b4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:11.404177 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c34681a5-c8f7-4c31-885c-db82bc1fa9b4 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1318 microversion: 2.1 time: 0.148383 Sep 20 22:27:11.404755 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 236/453] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:11 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:11.466292 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9cec3eda-a85c-4b8a-a9d5-16ac3eeebd9c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:11.466847 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9cec3eda-a85c-4b8a-a9d5-16ac3eeebd9c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:11.472910 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9cec3eda-a85c-4b8a-a9d5-16ac3eeebd9c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:11.473205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9cec3eda-a85c-4b8a-a9d5-16ac3eeebd9c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:11.473656 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9cec3eda-a85c-4b8a-a9d5-16ac3eeebd9c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:11.474443 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9cec3eda-a85c-4b8a-a9d5-16ac3eeebd9c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:11.474898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9cec3eda-a85c-4b8a-a9d5-16ac3eeebd9c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:11.475320 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9cec3eda-a85c-4b8a-a9d5-16ac3eeebd9c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:11.526706 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-4ab88c60-b31a-4565-a3a6-c0f03b6fc34a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:11.534691 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-4ab88c60-b31a-4565-a3a6-c0f03b6fc34a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1677 microversion: 2.1 time: 0.152822 Sep 20 22:27:11.535260 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 218/454] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:11 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:27:11.603966 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-9cec3eda-a85c-4b8a-a9d5-16ac3eeebd9c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:11.612466 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-9cec3eda-a85c-4b8a-a9d5-16ac3eeebd9c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:11.613940 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-9cec3eda-a85c-4b8a-a9d5-16ac3eeebd9c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:11.615742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-9cec3eda-a85c-4b8a-a9d5-16ac3eeebd9c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.152844 Sep 20 22:27:11.616566 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 237/455] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:27:11 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:27:12.427263 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-14edd08f-85c9-4b0d-9799-49dff9bbce55 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:12.428334 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-14edd08f-85c9-4b0d-9799-49dff9bbce55 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:12.434752 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-14edd08f-85c9-4b0d-9799-49dff9bbce55 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:12.435233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-14edd08f-85c9-4b0d-9799-49dff9bbce55 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:12.435668 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-14edd08f-85c9-4b0d-9799-49dff9bbce55 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:12.436355 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-14edd08f-85c9-4b0d-9799-49dff9bbce55 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:12.436806 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-14edd08f-85c9-4b0d-9799-49dff9bbce55 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:12.437258 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-14edd08f-85c9-4b0d-9799-49dff9bbce55 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:12.559527 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-89d37ff7-4510-4e2d-89e7-d70bb5897da4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:12.561002 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-89d37ff7-4510-4e2d-89e7-d70bb5897da4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:12.568026 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-89d37ff7-4510-4e2d-89e7-d70bb5897da4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:12.569322 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-89d37ff7-4510-4e2d-89e7-d70bb5897da4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:12.569985 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-89d37ff7-4510-4e2d-89e7-d70bb5897da4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:12.570200 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-14edd08f-85c9-4b0d-9799-49dff9bbce55 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:12.571260 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-89d37ff7-4510-4e2d-89e7-d70bb5897da4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:12.571939 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-89d37ff7-4510-4e2d-89e7-d70bb5897da4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:12.572564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-89d37ff7-4510-4e2d-89e7-d70bb5897da4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:12.578530 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-14edd08f-85c9-4b0d-9799-49dff9bbce55 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1318 microversion: 2.1 time: 0.155306 Sep 20 22:27:12.579451 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 219/456] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:12 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:12.642046 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-87bc66b4-19b9-43f4-ae6c-af20cb8a9f49 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:12.644773 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-87bc66b4-19b9-43f4-ae6c-af20cb8a9f49 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:12.661107 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-87bc66b4-19b9-43f4-ae6c-af20cb8a9f49 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:12.661930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-87bc66b4-19b9-43f4-ae6c-af20cb8a9f49 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:12.677180 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-87bc66b4-19b9-43f4-ae6c-af20cb8a9f49 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:12.678675 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-87bc66b4-19b9-43f4-ae6c-af20cb8a9f49 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:12.679107 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-87bc66b4-19b9-43f4-ae6c-af20cb8a9f49 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:12.679541 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-87bc66b4-19b9-43f4-ae6c-af20cb8a9f49 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:12.726276 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-89d37ff7-4510-4e2d-89e7-d70bb5897da4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:12.742566 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-89d37ff7-4510-4e2d-89e7-d70bb5897da4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1677 microversion: 2.1 time: 0.185607 Sep 20 22:27:12.742566 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 238/457] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:12 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:27:12.761595 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-e9557e20-f375-4239-b070-38e15f00f412 req-2042f690-2c50-4160-95a0-1d7870d3cc96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d58779-65b7-4b97-8536-eef4357a475d", "name": "network-vif-plugged", "status": "completed", "tag": "d965769d-834a-4b9f-817a-24e086032c2d"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:27:12.771756 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-e9557e20-f375-4239-b070-38e15f00f412 req-2042f690-2c50-4160-95a0-1d7870d3cc96 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:12.772248 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-e9557e20-f375-4239-b070-38e15f00f412 req-2042f690-2c50-4160-95a0-1d7870d3cc96 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:12.772661 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-e9557e20-f375-4239-b070-38e15f00f412 req-2042f690-2c50-4160-95a0-1d7870d3cc96 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:12.784139 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-e9557e20-f375-4239-b070-38e15f00f412 req-2042f690-2c50-4160-95a0-1d7870d3cc96 service nova] Creating event network-vif-plugged:d965769d-834a-4b9f-817a-24e086032c2d for instance 48d58779-65b7-4b97-8536-eef4357a475d on hv-cinder-85827 Sep 20 22:27:12.789872 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-e9557e20-f375-4239-b070-38e15f00f412 req-2042f690-2c50-4160-95a0-1d7870d3cc96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035122 Sep 20 22:27:12.790789 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 239/458] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:27:12.848231 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-87bc66b4-19b9-43f4-ae6c-af20cb8a9f49 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:12.858467 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-87bc66b4-19b9-43f4-ae6c-af20cb8a9f49 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:12.859599 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-87bc66b4-19b9-43f4-ae6c-af20cb8a9f49 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:12.861040 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-87bc66b4-19b9-43f4-ae6c-af20cb8a9f49 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.222825 Sep 20 22:27:12.873744 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 220/459] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:27:12 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:27:13.606557 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-97e4cae3-1ccc-4ca1-a937-2cdb9bd00f36 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:13.607191 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-97e4cae3-1ccc-4ca1-a937-2cdb9bd00f36 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:13.613324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-97e4cae3-1ccc-4ca1-a937-2cdb9bd00f36 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:13.613819 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-97e4cae3-1ccc-4ca1-a937-2cdb9bd00f36 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:13.614258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-97e4cae3-1ccc-4ca1-a937-2cdb9bd00f36 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:13.615531 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-97e4cae3-1ccc-4ca1-a937-2cdb9bd00f36 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:13.616265 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-97e4cae3-1ccc-4ca1-a937-2cdb9bd00f36 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:13.616680 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-97e4cae3-1ccc-4ca1-a937-2cdb9bd00f36 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:13.742388 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-97e4cae3-1ccc-4ca1-a937-2cdb9bd00f36 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:13.750003 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-97e4cae3-1ccc-4ca1-a937-2cdb9bd00f36 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1318 microversion: 2.1 time: 0.148354 Sep 20 22:27:13.750575 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 240/460] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:13 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:13.764600 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-94718af7-3430-470b-8312-e3e9a3386d68 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:13.765400 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-94718af7-3430-470b-8312-e3e9a3386d68 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:13.772010 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-94718af7-3430-470b-8312-e3e9a3386d68 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:13.772496 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-94718af7-3430-470b-8312-e3e9a3386d68 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:13.772934 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-94718af7-3430-470b-8312-e3e9a3386d68 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:13.773658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-94718af7-3430-470b-8312-e3e9a3386d68 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:13.774118 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-94718af7-3430-470b-8312-e3e9a3386d68 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:13.774547 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-94718af7-3430-470b-8312-e3e9a3386d68 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:13.900666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-6c42edb5-6162-412a-8afe-026b57d6d5d0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:13.900957 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-94718af7-3430-470b-8312-e3e9a3386d68 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:13.901754 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-6c42edb5-6162-412a-8afe-026b57d6d5d0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:13.908078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6c42edb5-6162-412a-8afe-026b57d6d5d0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:13.908599 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6c42edb5-6162-412a-8afe-026b57d6d5d0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:13.908724 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-94718af7-3430-470b-8312-e3e9a3386d68 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1677 microversion: 2.1 time: 0.148206 Sep 20 22:27:13.909066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6c42edb5-6162-412a-8afe-026b57d6d5d0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:13.909281 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 221/461] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:13 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:13.909778 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6c42edb5-6162-412a-8afe-026b57d6d5d0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:13.910237 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6c42edb5-6162-412a-8afe-026b57d6d5d0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:13.910660 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6c42edb5-6162-412a-8afe-026b57d6d5d0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:14.039541 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6c42edb5-6162-412a-8afe-026b57d6d5d0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:14.048074 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6c42edb5-6162-412a-8afe-026b57d6d5d0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:14.049562 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6c42edb5-6162-412a-8afe-026b57d6d5d0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:14.050790 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-6c42edb5-6162-412a-8afe-026b57d6d5d0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.155373 Sep 20 22:27:14.051349 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 241/462] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:27:13 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:27:14.773297 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-f92d03c7-fffd-4a33-b10f-c899756e450d tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:14.773914 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-f92d03c7-fffd-4a33-b10f-c899756e450d tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:14.780487 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f92d03c7-fffd-4a33-b10f-c899756e450d tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:14.781115 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f92d03c7-fffd-4a33-b10f-c899756e450d tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:14.781439 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f92d03c7-fffd-4a33-b10f-c899756e450d tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:14.782138 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f92d03c7-fffd-4a33-b10f-c899756e450d tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:14.782591 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f92d03c7-fffd-4a33-b10f-c899756e450d tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:14.783011 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f92d03c7-fffd-4a33-b10f-c899756e450d tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:14.811826 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-3e6e88f0-4a9a-47ec-9492-8975fe6e88bc req-9b133e9a-d243-426a-8762-040f99b34009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78d574ff-9ba0-4414-9527-4348b7f319b1", "name": "network-vif-plugged", "status": "completed", "tag": "9d9ce120-05ea-4d90-a0c6-fe7b78bb0049"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:27:14.823856 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-3e6e88f0-4a9a-47ec-9492-8975fe6e88bc req-9b133e9a-d243-426a-8762-040f99b34009 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:14.824433 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-3e6e88f0-4a9a-47ec-9492-8975fe6e88bc req-9b133e9a-d243-426a-8762-040f99b34009 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:14.824930 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-3e6e88f0-4a9a-47ec-9492-8975fe6e88bc req-9b133e9a-d243-426a-8762-040f99b34009 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:14.838974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-3e6e88f0-4a9a-47ec-9492-8975fe6e88bc req-9b133e9a-d243-426a-8762-040f99b34009 service nova] Creating event network-vif-plugged:9d9ce120-05ea-4d90-a0c6-fe7b78bb0049 for instance 78d574ff-9ba0-4414-9527-4348b7f319b1 on hv-cinder-85827 Sep 20 22:27:14.844260 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-3e6e88f0-4a9a-47ec-9492-8975fe6e88bc req-9b133e9a-d243-426a-8762-040f99b34009 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037261 Sep 20 22:27:14.844935 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 242/463] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:27:14.922518 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f92d03c7-fffd-4a33-b10f-c899756e450d tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:14.931667 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-f92d03c7-fffd-4a33-b10f-c899756e450d tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1318 microversion: 2.1 time: 0.162139 Sep 20 22:27:14.932457 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 222/464] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:14 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:14.934915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-fdc6303f-cffd-4819-83bc-a23f9c917bc3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:14.935644 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-fdc6303f-cffd-4819-83bc-a23f9c917bc3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:14.942392 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fdc6303f-cffd-4819-83bc-a23f9c917bc3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:14.943642 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fdc6303f-cffd-4819-83bc-a23f9c917bc3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:14.944266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fdc6303f-cffd-4819-83bc-a23f9c917bc3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:14.945258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fdc6303f-cffd-4819-83bc-a23f9c917bc3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:14.945887 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fdc6303f-cffd-4819-83bc-a23f9c917bc3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:14.946320 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fdc6303f-cffd-4819-83bc-a23f9c917bc3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:15.076939 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-3edadd1e-88ca-4547-bed6-9c1550dd67b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:15.077692 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-3edadd1e-88ca-4547-bed6-9c1550dd67b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:15.083863 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3edadd1e-88ca-4547-bed6-9c1550dd67b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:15.084215 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-fdc6303f-cffd-4819-83bc-a23f9c917bc3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:15.084369 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3edadd1e-88ca-4547-bed6-9c1550dd67b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:15.084791 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3edadd1e-88ca-4547-bed6-9c1550dd67b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:15.085532 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3edadd1e-88ca-4547-bed6-9c1550dd67b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:15.085993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3edadd1e-88ca-4547-bed6-9c1550dd67b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:15.086436 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3edadd1e-88ca-4547-bed6-9c1550dd67b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:15.095638 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-fdc6303f-cffd-4819-83bc-a23f9c917bc3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1677 microversion: 2.1 time: 0.165922 Sep 20 22:27:15.111013 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 243/465] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:14 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:27:15.235036 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-3edadd1e-88ca-4547-bed6-9c1550dd67b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:15.244920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-3edadd1e-88ca-4547-bed6-9c1550dd67b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:15.246431 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-3edadd1e-88ca-4547-bed6-9c1550dd67b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:15.247811 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-3edadd1e-88ca-4547-bed6-9c1550dd67b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1808 microversion: 2.20 time: 0.174747 Sep 20 22:27:15.248458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 223/466] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:27:15 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:27:15.954804 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ce4025f6-fd59-4a75-ba8e-97ff285b9b14 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:15.955402 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ce4025f6-fd59-4a75-ba8e-97ff285b9b14 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:15.962573 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ce4025f6-fd59-4a75-ba8e-97ff285b9b14 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:15.962999 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ce4025f6-fd59-4a75-ba8e-97ff285b9b14 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:15.963428 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ce4025f6-fd59-4a75-ba8e-97ff285b9b14 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:15.964113 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ce4025f6-fd59-4a75-ba8e-97ff285b9b14 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:15.964563 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ce4025f6-fd59-4a75-ba8e-97ff285b9b14 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:15.965005 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ce4025f6-fd59-4a75-ba8e-97ff285b9b14 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:16.092637 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ce4025f6-fd59-4a75-ba8e-97ff285b9b14 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:16.100197 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ce4025f6-fd59-4a75-ba8e-97ff285b9b14 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1318 microversion: 2.1 time: 0.149347 Sep 20 22:27:16.100761 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 244/467] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:15 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:16.118895 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-25144fcd-2ca0-4971-ac08-6136a6268488 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:16.119505 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-25144fcd-2ca0-4971-ac08-6136a6268488 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:16.125815 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-25144fcd-2ca0-4971-ac08-6136a6268488 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:16.126325 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-25144fcd-2ca0-4971-ac08-6136a6268488 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:16.126755 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-25144fcd-2ca0-4971-ac08-6136a6268488 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:16.127467 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-25144fcd-2ca0-4971-ac08-6136a6268488 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:16.127914 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-25144fcd-2ca0-4971-ac08-6136a6268488 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:16.128331 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-25144fcd-2ca0-4971-ac08-6136a6268488 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:16.254852 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-25144fcd-2ca0-4971-ac08-6136a6268488 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:16.262509 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-25144fcd-2ca0-4971-ac08-6136a6268488 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1677 microversion: 2.1 time: 0.148232 Sep 20 22:27:16.263069 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 224/468] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:16 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:16.273471 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3b2eb678-73da-43dd-8332-ffa510b7ae3e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:16.274246 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-3b2eb678-73da-43dd-8332-ffa510b7ae3e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:16.282505 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b2eb678-73da-43dd-8332-ffa510b7ae3e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:16.282996 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b2eb678-73da-43dd-8332-ffa510b7ae3e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:16.283433 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b2eb678-73da-43dd-8332-ffa510b7ae3e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:16.284127 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b2eb678-73da-43dd-8332-ffa510b7ae3e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:16.284586 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b2eb678-73da-43dd-8332-ffa510b7ae3e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:16.285044 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3b2eb678-73da-43dd-8332-ffa510b7ae3e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:16.416433 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3b2eb678-73da-43dd-8332-ffa510b7ae3e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:16.425221 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3b2eb678-73da-43dd-8332-ffa510b7ae3e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:16.426712 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3b2eb678-73da-43dd-8332-ffa510b7ae3e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:16.427873 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-3b2eb678-73da-43dd-8332-ffa510b7ae3e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1795 microversion: 2.20 time: 0.158892 Sep 20 22:27:16.428445 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 245/469] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:27:16 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1795 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:27:17.123650 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b0035e49-bfc9-47e5-adac-cc96362dd057 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:17.124267 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b0035e49-bfc9-47e5-adac-cc96362dd057 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:17.131430 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b0035e49-bfc9-47e5-adac-cc96362dd057 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:17.131861 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b0035e49-bfc9-47e5-adac-cc96362dd057 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:17.132295 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b0035e49-bfc9-47e5-adac-cc96362dd057 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:17.133011 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b0035e49-bfc9-47e5-adac-cc96362dd057 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:17.133476 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b0035e49-bfc9-47e5-adac-cc96362dd057 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:17.133907 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b0035e49-bfc9-47e5-adac-cc96362dd057 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:17.265688 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b0035e49-bfc9-47e5-adac-cc96362dd057 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:17.273385 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b0035e49-bfc9-47e5-adac-cc96362dd057 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1506 microversion: 2.1 time: 0.153777 Sep 20 22:27:17.273941 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 225/470] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:17 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:17.285387 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-e02b195f-4636-49e3-b939-8ad68ae314f7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:17.285997 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-e02b195f-4636-49e3-b939-8ad68ae314f7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:17.293129 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e02b195f-4636-49e3-b939-8ad68ae314f7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:17.293614 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e02b195f-4636-49e3-b939-8ad68ae314f7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:17.294052 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e02b195f-4636-49e3-b939-8ad68ae314f7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:17.294741 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e02b195f-4636-49e3-b939-8ad68ae314f7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:17.295192 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e02b195f-4636-49e3-b939-8ad68ae314f7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:17.295614 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e02b195f-4636-49e3-b939-8ad68ae314f7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:17.425330 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-e02b195f-4636-49e3-b939-8ad68ae314f7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:17.433676 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-e02b195f-4636-49e3-b939-8ad68ae314f7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1677 microversion: 2.1 time: 0.152115 Sep 20 22:27:17.434241 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 246/471] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:17 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:18.458161 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c5618418-4cfc-4c83-8ef1-7e2275516c09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:18.459333 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c5618418-4cfc-4c83-8ef1-7e2275516c09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:18.465802 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c5618418-4cfc-4c83-8ef1-7e2275516c09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:18.466283 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c5618418-4cfc-4c83-8ef1-7e2275516c09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:18.466719 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c5618418-4cfc-4c83-8ef1-7e2275516c09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:18.467402 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c5618418-4cfc-4c83-8ef1-7e2275516c09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:18.467855 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c5618418-4cfc-4c83-8ef1-7e2275516c09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:18.468276 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c5618418-4cfc-4c83-8ef1-7e2275516c09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:18.601030 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c5618418-4cfc-4c83-8ef1-7e2275516c09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:18.608909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-c5618418-4cfc-4c83-8ef1-7e2275516c09 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1677 microversion: 2.1 time: 0.155139 Sep 20 22:27:18.609515 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 226/472] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:18 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:19.633081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-61f75191-ba5b-494e-9fa2-165aae926a78 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:19.633686 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-61f75191-ba5b-494e-9fa2-165aae926a78 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:19.640077 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61f75191-ba5b-494e-9fa2-165aae926a78 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:19.640552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61f75191-ba5b-494e-9fa2-165aae926a78 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:19.641003 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61f75191-ba5b-494e-9fa2-165aae926a78 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:19.641686 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61f75191-ba5b-494e-9fa2-165aae926a78 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:19.642159 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61f75191-ba5b-494e-9fa2-165aae926a78 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:19.642576 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61f75191-ba5b-494e-9fa2-165aae926a78 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:19.775981 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-61f75191-ba5b-494e-9fa2-165aae926a78 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:19.783937 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-61f75191-ba5b-494e-9fa2-165aae926a78 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1677 microversion: 2.1 time: 0.154794 Sep 20 22:27:19.784545 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 247/473] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:19 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:27:20.808144 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-72b74bff-f387-4039-afcf-a0133731fccc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:20.808743 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-72b74bff-f387-4039-afcf-a0133731fccc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:20.815355 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-72b74bff-f387-4039-afcf-a0133731fccc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:20.816035 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-72b74bff-f387-4039-afcf-a0133731fccc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:20.816305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-72b74bff-f387-4039-afcf-a0133731fccc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:20.817022 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-72b74bff-f387-4039-afcf-a0133731fccc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:20.817483 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-72b74bff-f387-4039-afcf-a0133731fccc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:20.818106 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-72b74bff-f387-4039-afcf-a0133731fccc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:20.952933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-72b74bff-f387-4039-afcf-a0133731fccc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:20.960831 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-72b74bff-f387-4039-afcf-a0133731fccc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1677 microversion: 2.1 time: 0.156531 Sep 20 22:27:20.961453 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 227/474] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:20 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:21.079571 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f6dd58f0-9c54-4597-937b-d0f79cef21fb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6462f175-bf13-4ac7-bdc5-1487a4771d42"}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:27:21.081976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-f6dd58f0-9c54-4597-937b-d0f79cef21fb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:21.084616 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:21.090197 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f6dd58f0-9c54-4597-937b-d0f79cef21fb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:21.090688 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f6dd58f0-9c54-4597-937b-d0f79cef21fb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:21.091128 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f6dd58f0-9c54-4597-937b-d0f79cef21fb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:21.091907 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f6dd58f0-9c54-4597-937b-d0f79cef21fb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:21.092375 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f6dd58f0-9c54-4597-937b-d0f79cef21fb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:21.092802 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f6dd58f0-9c54-4597-937b-d0f79cef21fb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:21.097745 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=100 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:21.349908 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-f6dd58f0-9c54-4597-937b-d0f79cef21fb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "POST /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273576 Sep 20 22:27:21.350422 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 248/475] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 20 22:27:21 2022] POST /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:27:21.985216 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-843e1017-8af6-4280-88a9-93dd7da492fb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:21.985751 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-843e1017-8af6-4280-88a9-93dd7da492fb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:21.993163 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-843e1017-8af6-4280-88a9-93dd7da492fb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:21.993651 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-843e1017-8af6-4280-88a9-93dd7da492fb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:21.994096 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-843e1017-8af6-4280-88a9-93dd7da492fb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:21.994785 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-843e1017-8af6-4280-88a9-93dd7da492fb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:21.995240 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-843e1017-8af6-4280-88a9-93dd7da492fb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:21.995664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-843e1017-8af6-4280-88a9-93dd7da492fb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:22.128641 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-843e1017-8af6-4280-88a9-93dd7da492fb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:22.137793 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-843e1017-8af6-4280-88a9-93dd7da492fb tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1677 microversion: 2.1 time: 0.157709 Sep 20 22:27:22.138430 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 228/476] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:21 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:23.162811 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-7cccd096-3ebb-434e-a34f-028421b9273b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:23.163505 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-7cccd096-3ebb-434e-a34f-028421b9273b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:23.169819 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7cccd096-3ebb-434e-a34f-028421b9273b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:23.170297 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7cccd096-3ebb-434e-a34f-028421b9273b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:23.170728 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7cccd096-3ebb-434e-a34f-028421b9273b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:23.171422 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7cccd096-3ebb-434e-a34f-028421b9273b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:23.171867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7cccd096-3ebb-434e-a34f-028421b9273b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:23.172282 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7cccd096-3ebb-434e-a34f-028421b9273b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:23.303829 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-7cccd096-3ebb-434e-a34f-028421b9273b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:23.311796 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-7cccd096-3ebb-434e-a34f-028421b9273b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1677 microversion: 2.1 time: 0.154489 Sep 20 22:27:23.312393 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 249/477] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:23 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:27:24.336444 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-1a3283a0-c7bf-44ac-8d32-124a13189603 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:24.337084 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-1a3283a0-c7bf-44ac-8d32-124a13189603 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:24.343599 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1a3283a0-c7bf-44ac-8d32-124a13189603 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:24.344088 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1a3283a0-c7bf-44ac-8d32-124a13189603 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:24.344532 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1a3283a0-c7bf-44ac-8d32-124a13189603 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:24.345253 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1a3283a0-c7bf-44ac-8d32-124a13189603 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:24.345713 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1a3283a0-c7bf-44ac-8d32-124a13189603 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:24.346140 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1a3283a0-c7bf-44ac-8d32-124a13189603 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:24.477278 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-1a3283a0-c7bf-44ac-8d32-124a13189603 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:24.485352 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-1a3283a0-c7bf-44ac-8d32-124a13189603 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1677 microversion: 2.1 time: 0.153369 Sep 20 22:27:24.486124 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 229/478] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:24 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:25.510407 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-1f4b3486-2bd6-4961-8995-beb9e95f8e7e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:25.511044 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-1f4b3486-2bd6-4961-8995-beb9e95f8e7e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:25.517567 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1f4b3486-2bd6-4961-8995-beb9e95f8e7e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:25.518045 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1f4b3486-2bd6-4961-8995-beb9e95f8e7e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:25.518475 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1f4b3486-2bd6-4961-8995-beb9e95f8e7e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:25.519183 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1f4b3486-2bd6-4961-8995-beb9e95f8e7e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:25.519634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1f4b3486-2bd6-4961-8995-beb9e95f8e7e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:25.520051 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1f4b3486-2bd6-4961-8995-beb9e95f8e7e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:25.656173 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-1f4b3486-2bd6-4961-8995-beb9e95f8e7e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:25.663913 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-1f4b3486-2bd6-4961-8995-beb9e95f8e7e tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1654 microversion: 2.1 time: 0.157370 Sep 20 22:27:25.664667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 250/479] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:25 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1654 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:25.686973 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c0bf0fc3-6538-464b-93ee-4586135ba326 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:27:25.694004 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c0bf0fc3-6538-464b-93ee-4586135ba326 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:25.694479 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c0bf0fc3-6538-464b-93ee-4586135ba326 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:25.694906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c0bf0fc3-6538-464b-93ee-4586135ba326 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:25.751199 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=100 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:25.763590 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c0bf0fc3-6538-464b-93ee-4586135ba326 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Going to try to start instance {{(pid=120473) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 20 22:27:25.807468 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-c0bf0fc3-6538-464b-93ee-4586135ba326 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "POST /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0/action" status: 202 len: 0 microversion: 2.1 time: 0.124139 Sep 20 22:27:25.808139 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 230/480] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 20 22:27:25 2022] POST /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:27:25.816287 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5877b549-37af-434e-b3fb-bb83b2c17fb6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:25.816893 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5877b549-37af-434e-b3fb-bb83b2c17fb6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:25.823676 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5877b549-37af-434e-b3fb-bb83b2c17fb6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:25.824277 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5877b549-37af-434e-b3fb-bb83b2c17fb6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:25.824708 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5877b549-37af-434e-b3fb-bb83b2c17fb6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:25.825496 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5877b549-37af-434e-b3fb-bb83b2c17fb6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:25.826019 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5877b549-37af-434e-b3fb-bb83b2c17fb6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:25.826439 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5877b549-37af-434e-b3fb-bb83b2c17fb6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:25.961566 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-5877b549-37af-434e-b3fb-bb83b2c17fb6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:25.970401 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5877b549-37af-434e-b3fb-bb83b2c17fb6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1663 microversion: 2.1 time: 0.157814 Sep 20 22:27:25.970984 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 251/481] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:25 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:26.994904 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-3db98886-83e2-4e98-8339-745b5e220674 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:26.995515 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-3db98886-83e2-4e98-8339-745b5e220674 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:27.001663 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3db98886-83e2-4e98-8339-745b5e220674 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:27.002151 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3db98886-83e2-4e98-8339-745b5e220674 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:27.002584 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3db98886-83e2-4e98-8339-745b5e220674 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:27.003270 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3db98886-83e2-4e98-8339-745b5e220674 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:27.003725 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3db98886-83e2-4e98-8339-745b5e220674 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:27.004150 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3db98886-83e2-4e98-8339-745b5e220674 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:27.134379 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-3db98886-83e2-4e98-8339-745b5e220674 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:27.141972 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-3db98886-83e2-4e98-8339-745b5e220674 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1663 microversion: 2.1 time: 0.152209 Sep 20 22:27:27.142565 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 231/482] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:26 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:27:28.166016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-dda87085-8187-4e21-9894-85591d5d7d1b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:28.166540 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-dda87085-8187-4e21-9894-85591d5d7d1b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:28.172900 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dda87085-8187-4e21-9894-85591d5d7d1b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:28.173416 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dda87085-8187-4e21-9894-85591d5d7d1b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:28.174110 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dda87085-8187-4e21-9894-85591d5d7d1b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:28.174614 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dda87085-8187-4e21-9894-85591d5d7d1b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:28.175066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dda87085-8187-4e21-9894-85591d5d7d1b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:28.175487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dda87085-8187-4e21-9894-85591d5d7d1b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:28.301768 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-dda87085-8187-4e21-9894-85591d5d7d1b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:28.309397 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-dda87085-8187-4e21-9894-85591d5d7d1b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1667 microversion: 2.1 time: 0.147897 Sep 20 22:27:28.309965 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 252/483] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:28 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1667 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:28.896729 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8dff748d-d05f-4f70-a55c-196b5b4d8ab6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:27:28.899073 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8dff748d-d05f-4f70-a55c-196b5b4d8ab6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:28.905421 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8dff748d-d05f-4f70-a55c-196b5b4d8ab6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:28.905902 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8dff748d-d05f-4f70-a55c-196b5b4d8ab6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:28.906347 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8dff748d-d05f-4f70-a55c-196b5b4d8ab6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:28.907015 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8dff748d-d05f-4f70-a55c-196b5b4d8ab6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:28.907467 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8dff748d-d05f-4f70-a55c-196b5b4d8ab6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:28.907889 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8dff748d-d05f-4f70-a55c-196b5b4d8ab6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:28.930674 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-8dff748d-d05f-4f70-a55c-196b5b4d8ab6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lazy-loading 'flavor' on Instance uuid 704f353f-861e-47cf-9625-7210f9f1f81e {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:27:29.084443 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-8dff748d-d05f-4f70-a55c-196b5b4d8ab6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "POST /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/action" status: 200 len: 32 microversion: 2.1 time: 0.192095 Sep 20 22:27:29.085090 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 232/484] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 20 22:27:28 2022] POST /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 20 22:27:29.094592 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-443e700b-b9d0-436b-999f-7f06a7d23ab8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:29.095204 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-443e700b-b9d0-436b-999f-7f06a7d23ab8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:29.101318 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-443e700b-b9d0-436b-999f-7f06a7d23ab8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:29.101808 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-443e700b-b9d0-436b-999f-7f06a7d23ab8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:29.102381 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-443e700b-b9d0-436b-999f-7f06a7d23ab8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:29.103120 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-443e700b-b9d0-436b-999f-7f06a7d23ab8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:29.103575 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-443e700b-b9d0-436b-999f-7f06a7d23ab8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:29.104139 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-443e700b-b9d0-436b-999f-7f06a7d23ab8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:29.233783 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-443e700b-b9d0-436b-999f-7f06a7d23ab8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:29.242615 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-443e700b-b9d0-436b-999f-7f06a7d23ab8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.151922 Sep 20 22:27:29.243186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 253/485] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:29 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:30.267832 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-4ee731bf-9b39-490f-8bd6-6e4b203a18c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:30.268529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-4ee731bf-9b39-490f-8bd6-6e4b203a18c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:30.274578 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ee731bf-9b39-490f-8bd6-6e4b203a18c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:30.275057 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ee731bf-9b39-490f-8bd6-6e4b203a18c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:30.275492 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ee731bf-9b39-490f-8bd6-6e4b203a18c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:30.276175 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ee731bf-9b39-490f-8bd6-6e4b203a18c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:30.276626 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ee731bf-9b39-490f-8bd6-6e4b203a18c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:30.277082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ee731bf-9b39-490f-8bd6-6e4b203a18c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:30.409257 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-4ee731bf-9b39-490f-8bd6-6e4b203a18c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:30.417904 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-4ee731bf-9b39-490f-8bd6-6e4b203a18c8 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.154879 Sep 20 22:27:30.418468 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 233/486] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:30 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:31.440632 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a28d4e5c-3731-4eaf-9b9a-8d324a4d1da5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:31.441295 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a28d4e5c-3731-4eaf-9b9a-8d324a4d1da5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:31.448583 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a28d4e5c-3731-4eaf-9b9a-8d324a4d1da5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:31.449097 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a28d4e5c-3731-4eaf-9b9a-8d324a4d1da5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:31.449536 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a28d4e5c-3731-4eaf-9b9a-8d324a4d1da5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:31.450242 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a28d4e5c-3731-4eaf-9b9a-8d324a4d1da5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:31.450684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a28d4e5c-3731-4eaf-9b9a-8d324a4d1da5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:31.451106 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a28d4e5c-3731-4eaf-9b9a-8d324a4d1da5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:31.579791 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a28d4e5c-3731-4eaf-9b9a-8d324a4d1da5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:31.588530 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a28d4e5c-3731-4eaf-9b9a-8d324a4d1da5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.151736 Sep 20 22:27:31.589142 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 254/487] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:31 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:32.611735 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-f55346dd-53b5-4f59-a05d-75b449c18386 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:32.612335 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-f55346dd-53b5-4f59-a05d-75b449c18386 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:32.620648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f55346dd-53b5-4f59-a05d-75b449c18386 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:32.621177 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f55346dd-53b5-4f59-a05d-75b449c18386 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:32.621607 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f55346dd-53b5-4f59-a05d-75b449c18386 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:32.622298 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f55346dd-53b5-4f59-a05d-75b449c18386 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:32.622747 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f55346dd-53b5-4f59-a05d-75b449c18386 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:32.623165 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f55346dd-53b5-4f59-a05d-75b449c18386 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:32.752832 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f55346dd-53b5-4f59-a05d-75b449c18386 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:32.760875 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-f55346dd-53b5-4f59-a05d-75b449c18386 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.153061 Sep 20 22:27:32.761474 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 234/488] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:32 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:33.528381 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-11b871d1-05ae-4751-9f9e-e3710cd42cec tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ff8409a-a542-4b66-b785-add4be58fca7", "device": "/dev/sdb"}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:27:33.531350 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-11b871d1-05ae-4751-9f9e-e3710cd42cec tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:33.538330 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-11b871d1-05ae-4751-9f9e-e3710cd42cec tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:33.538810 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-11b871d1-05ae-4751-9f9e-e3710cd42cec tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:33.539244 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-11b871d1-05ae-4751-9f9e-e3710cd42cec tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:33.539961 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-11b871d1-05ae-4751-9f9e-e3710cd42cec tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:33.540412 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-11b871d1-05ae-4751-9f9e-e3710cd42cec tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:33.540833 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-11b871d1-05ae-4751-9f9e-e3710cd42cec tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:33.774262 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-11b871d1-05ae-4751-9f9e-e3710cd42cec tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "POST /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249508 Sep 20 22:27:33.774874 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 255/489] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 20 22:27:33 2022] POST /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:27:33.783581 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-9dace77a-165c-4bcd-ad27-469f0b195804 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:33.784185 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-9dace77a-165c-4bcd-ad27-469f0b195804 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:33.791026 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9dace77a-165c-4bcd-ad27-469f0b195804 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:33.791548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9dace77a-165c-4bcd-ad27-469f0b195804 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:33.792174 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9dace77a-165c-4bcd-ad27-469f0b195804 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:33.793050 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9dace77a-165c-4bcd-ad27-469f0b195804 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:33.793517 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9dace77a-165c-4bcd-ad27-469f0b195804 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:33.793944 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9dace77a-165c-4bcd-ad27-469f0b195804 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:33.940707 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-9dace77a-165c-4bcd-ad27-469f0b195804 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:33.949776 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-9dace77a-165c-4bcd-ad27-469f0b195804 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.170067 Sep 20 22:27:33.950351 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 235/490] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:33 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:34.975535 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-69ee048c-d982-4907-aff4-1054cd9cc2ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:34.976230 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-69ee048c-d982-4907-aff4-1054cd9cc2ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:34.983122 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-69ee048c-d982-4907-aff4-1054cd9cc2ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:34.983589 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-69ee048c-d982-4907-aff4-1054cd9cc2ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:34.984026 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-69ee048c-d982-4907-aff4-1054cd9cc2ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:34.984719 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-69ee048c-d982-4907-aff4-1054cd9cc2ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:34.985205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-69ee048c-d982-4907-aff4-1054cd9cc2ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:34.985639 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-69ee048c-d982-4907-aff4-1054cd9cc2ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:35.114355 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-69ee048c-d982-4907-aff4-1054cd9cc2ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:35.122765 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-69ee048c-d982-4907-aff4-1054cd9cc2ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.152424 Sep 20 22:27:35.123335 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 256/491] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:34 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:36.145560 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-aec5b4bc-997a-4498-89f0-4839bebe8c47 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:36.146203 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-aec5b4bc-997a-4498-89f0-4839bebe8c47 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:36.148884 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=50 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:36.154182 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-aec5b4bc-997a-4498-89f0-4839bebe8c47 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:36.154660 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-aec5b4bc-997a-4498-89f0-4839bebe8c47 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:36.155093 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-aec5b4bc-997a-4498-89f0-4839bebe8c47 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:36.155782 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-aec5b4bc-997a-4498-89f0-4839bebe8c47 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:36.156233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-aec5b4bc-997a-4498-89f0-4839bebe8c47 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:36.156660 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-aec5b4bc-997a-4498-89f0-4839bebe8c47 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:36.280213 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-aec5b4bc-997a-4498-89f0-4839bebe8c47 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:36.288735 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-aec5b4bc-997a-4498-89f0-4839bebe8c47 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.147000 Sep 20 22:27:36.289335 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 236/492] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:36 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:37.311552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-71624447-bb79-4b69-900c-9bee971fe65f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:37.312164 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-71624447-bb79-4b69-900c-9bee971fe65f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:37.318732 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-71624447-bb79-4b69-900c-9bee971fe65f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:37.319240 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-71624447-bb79-4b69-900c-9bee971fe65f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:37.319671 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-71624447-bb79-4b69-900c-9bee971fe65f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:37.320358 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-71624447-bb79-4b69-900c-9bee971fe65f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:37.320807 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-71624447-bb79-4b69-900c-9bee971fe65f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:37.321260 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-71624447-bb79-4b69-900c-9bee971fe65f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:37.444830 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-71624447-bb79-4b69-900c-9bee971fe65f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:37.453056 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-71624447-bb79-4b69-900c-9bee971fe65f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.145369 Sep 20 22:27:37.453628 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 257/493] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:37 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:38.475988 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-40421746-4b36-4f19-8b20-88e439cf0ccf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:38.476600 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-40421746-4b36-4f19-8b20-88e439cf0ccf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:38.483045 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-40421746-4b36-4f19-8b20-88e439cf0ccf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:38.483527 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-40421746-4b36-4f19-8b20-88e439cf0ccf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:38.483962 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-40421746-4b36-4f19-8b20-88e439cf0ccf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:38.484648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-40421746-4b36-4f19-8b20-88e439cf0ccf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:38.485143 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-40421746-4b36-4f19-8b20-88e439cf0ccf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:38.485566 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-40421746-4b36-4f19-8b20-88e439cf0ccf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:38.612138 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-40421746-4b36-4f19-8b20-88e439cf0ccf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:38.621091 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-40421746-4b36-4f19-8b20-88e439cf0ccf tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.148975 Sep 20 22:27:38.621660 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 237/494] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:38 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:39.644540 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ac523987-573c-481a-bfa8-12d8e9d87794 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:39.645203 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ac523987-573c-481a-bfa8-12d8e9d87794 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:39.651627 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ac523987-573c-481a-bfa8-12d8e9d87794 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:39.652133 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ac523987-573c-481a-bfa8-12d8e9d87794 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:39.652560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ac523987-573c-481a-bfa8-12d8e9d87794 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:39.653286 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ac523987-573c-481a-bfa8-12d8e9d87794 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:39.653733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ac523987-573c-481a-bfa8-12d8e9d87794 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:39.654149 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ac523987-573c-481a-bfa8-12d8e9d87794 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:39.783842 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ac523987-573c-481a-bfa8-12d8e9d87794 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:39.792101 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ac523987-573c-481a-bfa8-12d8e9d87794 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.151420 Sep 20 22:27:39.792663 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 258/495] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:39 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:40.815331 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-413e8267-f930-47c3-bacc-8ecdb99429bd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:40.815986 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-413e8267-f930-47c3-bacc-8ecdb99429bd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:40.822421 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-413e8267-f930-47c3-bacc-8ecdb99429bd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:40.822904 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-413e8267-f930-47c3-bacc-8ecdb99429bd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:40.823342 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-413e8267-f930-47c3-bacc-8ecdb99429bd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:40.824029 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-413e8267-f930-47c3-bacc-8ecdb99429bd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:40.824484 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-413e8267-f930-47c3-bacc-8ecdb99429bd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:40.824907 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-413e8267-f930-47c3-bacc-8ecdb99429bd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:40.951280 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-413e8267-f930-47c3-bacc-8ecdb99429bd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:40.959938 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-413e8267-f930-47c3-bacc-8ecdb99429bd tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.148479 Sep 20 22:27:40.960511 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 238/496] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:40 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:41.984074 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4a4aa578-eb1f-4530-a6f5-7e52f8ff8518 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:41.984650 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4a4aa578-eb1f-4530-a6f5-7e52f8ff8518 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:41.991848 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4a4aa578-eb1f-4530-a6f5-7e52f8ff8518 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:41.992329 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4a4aa578-eb1f-4530-a6f5-7e52f8ff8518 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:41.992760 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4a4aa578-eb1f-4530-a6f5-7e52f8ff8518 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:41.993466 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4a4aa578-eb1f-4530-a6f5-7e52f8ff8518 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:41.993918 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4a4aa578-eb1f-4530-a6f5-7e52f8ff8518 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:41.994338 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4a4aa578-eb1f-4530-a6f5-7e52f8ff8518 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:42.125556 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4a4aa578-eb1f-4530-a6f5-7e52f8ff8518 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:42.135733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4a4aa578-eb1f-4530-a6f5-7e52f8ff8518 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.155524 Sep 20 22:27:42.136520 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 259/497] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:41 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:43.159013 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-91636c08-231d-4b4b-ae68-7bfcd7ed47f5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:43.159623 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-91636c08-231d-4b4b-ae68-7bfcd7ed47f5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:43.166011 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-91636c08-231d-4b4b-ae68-7bfcd7ed47f5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:43.166494 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-91636c08-231d-4b4b-ae68-7bfcd7ed47f5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:43.166926 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-91636c08-231d-4b4b-ae68-7bfcd7ed47f5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:43.167646 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-91636c08-231d-4b4b-ae68-7bfcd7ed47f5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:43.168100 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-91636c08-231d-4b4b-ae68-7bfcd7ed47f5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:43.168521 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-91636c08-231d-4b4b-ae68-7bfcd7ed47f5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:43.292214 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-91636c08-231d-4b4b-ae68-7bfcd7ed47f5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:43.300374 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-91636c08-231d-4b4b-ae68-7bfcd7ed47f5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.145275 Sep 20 22:27:43.300937 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 239/498] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:43 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:44.324076 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-7608002d-9992-4269-ab31-270b184dbe24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:44.324681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-7608002d-9992-4269-ab31-270b184dbe24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:44.331081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7608002d-9992-4269-ab31-270b184dbe24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:44.331556 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7608002d-9992-4269-ab31-270b184dbe24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:44.331985 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7608002d-9992-4269-ab31-270b184dbe24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:44.332664 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7608002d-9992-4269-ab31-270b184dbe24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:44.333751 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7608002d-9992-4269-ab31-270b184dbe24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:44.334169 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7608002d-9992-4269-ab31-270b184dbe24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:44.457584 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-7608002d-9992-4269-ab31-270b184dbe24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:44.466244 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-7608002d-9992-4269-ab31-270b184dbe24 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.146033 Sep 20 22:27:44.466804 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 260/499] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:44 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:45.489227 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ed20cb00-a0bd-4850-a60f-fdd3fde33fd2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:45.489836 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ed20cb00-a0bd-4850-a60f-fdd3fde33fd2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:45.496458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ed20cb00-a0bd-4850-a60f-fdd3fde33fd2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:45.496937 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ed20cb00-a0bd-4850-a60f-fdd3fde33fd2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:45.497402 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ed20cb00-a0bd-4850-a60f-fdd3fde33fd2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:45.498090 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ed20cb00-a0bd-4850-a60f-fdd3fde33fd2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:45.498542 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ed20cb00-a0bd-4850-a60f-fdd3fde33fd2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:45.499000 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ed20cb00-a0bd-4850-a60f-fdd3fde33fd2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:45.726647 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ed20cb00-a0bd-4850-a60f-fdd3fde33fd2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:45.739668 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ed20cb00-a0bd-4850-a60f-fdd3fde33fd2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.254222 Sep 20 22:27:45.740991 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 240/500] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:45 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:46.765659 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-34c68b22-4817-4746-b8a4-9391c5aa8a2d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:46.766261 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-34c68b22-4817-4746-b8a4-9391c5aa8a2d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:46.773024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-34c68b22-4817-4746-b8a4-9391c5aa8a2d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:46.773521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-34c68b22-4817-4746-b8a4-9391c5aa8a2d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:46.773954 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-34c68b22-4817-4746-b8a4-9391c5aa8a2d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:46.774680 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-34c68b22-4817-4746-b8a4-9391c5aa8a2d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:46.775131 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-34c68b22-4817-4746-b8a4-9391c5aa8a2d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:46.775553 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-34c68b22-4817-4746-b8a4-9391c5aa8a2d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:46.906532 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-34c68b22-4817-4746-b8a4-9391c5aa8a2d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:46.915259 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-34c68b22-4817-4746-b8a4-9391c5aa8a2d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.153425 Sep 20 22:27:46.915826 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 261/501] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:46 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:47.937963 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-40351310-a32e-4c28-b39a-331812b05a76 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:47.938570 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-40351310-a32e-4c28-b39a-331812b05a76 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:47.945677 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-40351310-a32e-4c28-b39a-331812b05a76 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:47.946155 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-40351310-a32e-4c28-b39a-331812b05a76 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:47.946587 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-40351310-a32e-4c28-b39a-331812b05a76 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:47.947266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-40351310-a32e-4c28-b39a-331812b05a76 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:47.947728 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-40351310-a32e-4c28-b39a-331812b05a76 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:47.948164 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-40351310-a32e-4c28-b39a-331812b05a76 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:48.073900 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-40351310-a32e-4c28-b39a-331812b05a76 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:48.081866 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-40351310-a32e-4c28-b39a-331812b05a76 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.147721 Sep 20 22:27:48.082430 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 241/502] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:47 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:49.105223 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-10ee298f-8161-4ed0-a338-3325ef830515 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:49.105754 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-10ee298f-8161-4ed0-a338-3325ef830515 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:49.112509 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-10ee298f-8161-4ed0-a338-3325ef830515 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:49.113021 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-10ee298f-8161-4ed0-a338-3325ef830515 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:49.113462 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-10ee298f-8161-4ed0-a338-3325ef830515 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:49.114170 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-10ee298f-8161-4ed0-a338-3325ef830515 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:49.114612 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-10ee298f-8161-4ed0-a338-3325ef830515 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:49.115033 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-10ee298f-8161-4ed0-a338-3325ef830515 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:49.119475 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:49.246318 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-10ee298f-8161-4ed0-a338-3325ef830515 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:49.254551 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-10ee298f-8161-4ed0-a338-3325ef830515 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.153875 Sep 20 22:27:49.255186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 262/503] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:49 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:50.277687 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b60dcd5a-10f7-4f04-9bd3-f98c7a2d0459 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:50.278231 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b60dcd5a-10f7-4f04-9bd3-f98c7a2d0459 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:50.284663 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b60dcd5a-10f7-4f04-9bd3-f98c7a2d0459 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:50.285131 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b60dcd5a-10f7-4f04-9bd3-f98c7a2d0459 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:50.285571 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b60dcd5a-10f7-4f04-9bd3-f98c7a2d0459 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:50.286806 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b60dcd5a-10f7-4f04-9bd3-f98c7a2d0459 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:50.287264 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b60dcd5a-10f7-4f04-9bd3-f98c7a2d0459 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:50.287688 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b60dcd5a-10f7-4f04-9bd3-f98c7a2d0459 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:50.421310 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b60dcd5a-10f7-4f04-9bd3-f98c7a2d0459 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:50.429432 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b60dcd5a-10f7-4f04-9bd3-f98c7a2d0459 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.155741 Sep 20 22:27:50.430016 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 242/504] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:50 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:51.452342 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-1146f9f1-8516-44b2-8fac-fe24438dcf48 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:51.452943 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-1146f9f1-8516-44b2-8fac-fe24438dcf48 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:51.455263 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=30 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:51.460827 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1146f9f1-8516-44b2-8fac-fe24438dcf48 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:51.461490 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1146f9f1-8516-44b2-8fac-fe24438dcf48 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:51.461991 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1146f9f1-8516-44b2-8fac-fe24438dcf48 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:51.462691 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1146f9f1-8516-44b2-8fac-fe24438dcf48 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:51.463141 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1146f9f1-8516-44b2-8fac-fe24438dcf48 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:51.463616 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1146f9f1-8516-44b2-8fac-fe24438dcf48 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:51.592705 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-1146f9f1-8516-44b2-8fac-fe24438dcf48 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:51.601430 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-1146f9f1-8516-44b2-8fac-fe24438dcf48 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.152906 Sep 20 22:27:51.601990 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 263/505] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:51 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:52.624267 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6a37d45d-78b4-4667-95be-851ce998c0e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:52.624900 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-6a37d45d-78b4-4667-95be-851ce998c0e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:52.631744 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6a37d45d-78b4-4667-95be-851ce998c0e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:52.632267 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6a37d45d-78b4-4667-95be-851ce998c0e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:52.632699 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6a37d45d-78b4-4667-95be-851ce998c0e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:52.633545 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6a37d45d-78b4-4667-95be-851ce998c0e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:52.634053 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6a37d45d-78b4-4667-95be-851ce998c0e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:52.634490 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6a37d45d-78b4-4667-95be-851ce998c0e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:52.758920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-6a37d45d-78b4-4667-95be-851ce998c0e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:52.766917 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-6a37d45d-78b4-4667-95be-851ce998c0e3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.146563 Sep 20 22:27:52.767486 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 243/506] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:52 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:53.789683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-8befb0e0-dcca-4e25-af33-fe8b9b0b5b1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:53.790290 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-8befb0e0-dcca-4e25-af33-fe8b9b0b5b1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:53.796673 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8befb0e0-dcca-4e25-af33-fe8b9b0b5b1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:53.797196 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8befb0e0-dcca-4e25-af33-fe8b9b0b5b1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:53.797633 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8befb0e0-dcca-4e25-af33-fe8b9b0b5b1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:53.798319 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8befb0e0-dcca-4e25-af33-fe8b9b0b5b1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:53.798771 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8befb0e0-dcca-4e25-af33-fe8b9b0b5b1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:53.799196 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8befb0e0-dcca-4e25-af33-fe8b9b0b5b1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:53.925649 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-8befb0e0-dcca-4e25-af33-fe8b9b0b5b1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:53.934835 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-8befb0e0-dcca-4e25-af33-fe8b9b0b5b1a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.149493 Sep 20 22:27:53.935604 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 264/507] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:53 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:54.958829 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-53ad45d2-60b8-4aea-aca3-d7e1f8fcf90a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:54.959439 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-53ad45d2-60b8-4aea-aca3-d7e1f8fcf90a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:54.966012 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-53ad45d2-60b8-4aea-aca3-d7e1f8fcf90a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:54.966497 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-53ad45d2-60b8-4aea-aca3-d7e1f8fcf90a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:54.966933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-53ad45d2-60b8-4aea-aca3-d7e1f8fcf90a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:54.967657 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-53ad45d2-60b8-4aea-aca3-d7e1f8fcf90a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:54.968110 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-53ad45d2-60b8-4aea-aca3-d7e1f8fcf90a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:54.968534 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-53ad45d2-60b8-4aea-aca3-d7e1f8fcf90a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:54.971186 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:55.096451 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-53ad45d2-60b8-4aea-aca3-d7e1f8fcf90a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:55.104610 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-53ad45d2-60b8-4aea-aca3-d7e1f8fcf90a tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1735 microversion: 2.1 time: 0.149601 Sep 20 22:27:55.105205 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 244/508] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:54 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:56.128581 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-87c48de2-da15-4cee-a13c-a236af161a34 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:56.129123 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-87c48de2-da15-4cee-a13c-a236af161a34 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:56.135478 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-87c48de2-da15-4cee-a13c-a236af161a34 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:56.135953 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-87c48de2-da15-4cee-a13c-a236af161a34 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:56.136377 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-87c48de2-da15-4cee-a13c-a236af161a34 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:56.137088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-87c48de2-da15-4cee-a13c-a236af161a34 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:56.137536 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-87c48de2-da15-4cee-a13c-a236af161a34 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:56.137973 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-87c48de2-da15-4cee-a13c-a236af161a34 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:56.264081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-87c48de2-da15-4cee-a13c-a236af161a34 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:56.273041 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-87c48de2-da15-4cee-a13c-a236af161a34 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1715 microversion: 2.1 time: 0.148324 Sep 20 22:27:56.273685 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 265/509] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:56 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1715 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:56.388615 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0c75c7a1-260e-42ba-b128-9376a65dde95 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:56.389236 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-0c75c7a1-260e-42ba-b128-9376a65dde95 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:56.396296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0c75c7a1-260e-42ba-b128-9376a65dde95 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:56.396845 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0c75c7a1-260e-42ba-b128-9376a65dde95 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:56.397357 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0c75c7a1-260e-42ba-b128-9376a65dde95 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:56.398353 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0c75c7a1-260e-42ba-b128-9376a65dde95 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:56.398874 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0c75c7a1-260e-42ba-b128-9376a65dde95 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:56.399428 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0c75c7a1-260e-42ba-b128-9376a65dde95 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:56.532599 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-0c75c7a1-260e-42ba-b128-9376a65dde95 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] HTTP exception thrown: Cannot 'detach_volume' instance 704f353f-861e-47cf-9625-7210f9f1f81e while it is in vm_state rescued Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0c75c7a1-260e-42ba-b128-9376a65dde95 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Request method failure captured: Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: DELETE /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-volume_attachments/6462f175-bf13-4ac7-bdc5-1487a4771d42 HTTP/1.1 Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj121zgLwFJmRdY8P7mlmZ0v-f9HObvaDYJxym52l22Y024SfHGWFrqhydZ0ZORQZ7-32KLCyqBkv_IlwCXlVT0i8YM1I13VcrEKJTKuP6ul-aOq7DYohb9IE3g2mh3VHvoeTrM31ytaLizPn4LX9RAhk2JxUd9tYcXBoVxsD6N2zWY Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: e1076a54706448038779945f53703345 Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-475540964 Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:27:56.534226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:27:56.536360 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e1076a54706448038779945f53703345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e1076a54706448038779945f53703345", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e1076a54706448038779945f53703345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e1076a54706448038779945f53703345"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:27:56.536360 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-ServerRescueNegativeTestJSON-475540964 Sep 20 22:27:56.536360 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: e1076a54706448038779945f53703345 Sep 20 22:27:56.536360 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-475540964 Sep 20 22:27:56.536360 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-ServerRescueNegativeTestJSON-475540964-project Sep 20 22:27:56.536360 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:27:56.536360 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:27:56.536360 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 55ab0d396ace494c8884d21d41a04e72 Sep 20 22:27:56.536360 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-ServerRescueNegativeTestJSON-475540964-project Sep 20 22:27:56.536360 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:27:56.536360 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Cannot 'detach_volume' instance 704f353f-861e-47cf-9625-7210f9f1f81e while it is in vm_state rescued Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'server_id': '704f353f-861e-47cf-9625-7210f9f1f81e', 'id': '6462f175-bf13-4ac7-bdc5-1487a4771d42'} Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 704f353f-861e-47cf-9625-7210f9f1f81e in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:27:56.537173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:27:56.538721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 20 22:27:56.538721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 20 22:27:56.538721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 20 22:27:56.538721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 20 22:27:56.538721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 704f353f-861e-47cf-9625-7210f9f1f81e while it is in vm_state rescued Sep 20 22:27:56.538721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:27:56.538721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:27:56.538721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:27:56.538721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:27:56.538721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:27:56.538721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:27:56.538721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:27:56.538721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:27:56.538721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 704f353f-861e-47cf-9625-7210f9f1f81e while it is in vm_state rescued Sep 20 22:27:56.538721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:27:56.538721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0c75c7a1-260e-42ba-b128-9376a65dde95 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Returning 409 to user: Cannot 'detach_volume' instance 704f353f-861e-47cf-9625-7210f9f1f81e while it is in vm_state rescued {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:27:56.540028 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-0c75c7a1-260e-42ba-b128-9376a65dde95 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "DELETE /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-volume_attachments/6462f175-bf13-4ac7-bdc5-1487a4771d42" status: 409 len: 152 microversion: 2.1 time: 0.151012 Sep 20 22:27:56.540028 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 245/510] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 20 22:27:56 2022] DELETE /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-volume_attachments/6462f175-bf13-4ac7-bdc5-1487a4771d42 => generated 152 bytes in 153 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 20 22:27:56.545284 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9cf54798-32b9-442b-9324-99860edb6a33 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:27:56.545879 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9cf54798-32b9-442b-9324-99860edb6a33 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:56.551839 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9cf54798-32b9-442b-9324-99860edb6a33 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:56.552336 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9cf54798-32b9-442b-9324-99860edb6a33 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:56.552764 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9cf54798-32b9-442b-9324-99860edb6a33 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:56.553471 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9cf54798-32b9-442b-9324-99860edb6a33 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:56.553938 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9cf54798-32b9-442b-9324-99860edb6a33 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:56.554355 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9cf54798-32b9-442b-9324-99860edb6a33 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:56.620465 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-9cf54798-32b9-442b-9324-99860edb6a33 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "POST /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/action" status: 202 len: 0 microversion: 2.1 time: 0.078782 Sep 20 22:27:56.621283 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 266/511] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 20 22:27:56 2022] POST /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:27:56.630104 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-46e682df-066f-4932-80ee-35a137481e5c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:56.630634 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-46e682df-066f-4932-80ee-35a137481e5c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:56.640299 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-46e682df-066f-4932-80ee-35a137481e5c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:56.640780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-46e682df-066f-4932-80ee-35a137481e5c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:56.641565 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-46e682df-066f-4932-80ee-35a137481e5c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:56.642492 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-46e682df-066f-4932-80ee-35a137481e5c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:56.642967 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-46e682df-066f-4932-80ee-35a137481e5c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:56.643392 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-46e682df-066f-4932-80ee-35a137481e5c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:56.848309 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-46e682df-066f-4932-80ee-35a137481e5c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:56.856441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-46e682df-066f-4932-80ee-35a137481e5c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1723 microversion: 2.1 time: 0.230702 Sep 20 22:27:56.857028 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 246/512] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:56 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:57.515919 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-07987eb2-7956-4c26-b207-60e8465e0460 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:57.516502 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-07987eb2-7956-4c26-b207-60e8465e0460 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:57.522634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-07987eb2-7956-4c26-b207-60e8465e0460 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:57.523119 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-07987eb2-7956-4c26-b207-60e8465e0460 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:57.523551 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-07987eb2-7956-4c26-b207-60e8465e0460 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:57.524231 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-07987eb2-7956-4c26-b207-60e8465e0460 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:57.524682 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-07987eb2-7956-4c26-b207-60e8465e0460 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:57.525142 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-07987eb2-7956-4c26-b207-60e8465e0460 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:57.605229 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-07987eb2-7956-4c26-b207-60e8465e0460 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lazy-loading 'services' on Instance uuid 78d574ff-9ba0-4414-9527-4348b7f319b1 {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:27:57.677017 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-07987eb2-7956-4c26-b207-60e8465e0460 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "DELETE /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1/os-volume_attachments/4ff8409a-a542-4b66-b785-add4be58fca7" status: 202 len: 0 microversion: 2.1 time: 0.165080 Sep 20 22:27:57.677617 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 267/513] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 20 22:27:57 2022] DELETE /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1/os-volume_attachments/4ff8409a-a542-4b66-b785-add4be58fca7 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:27:57.879687 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-92d39162-aa30-42f0-874f-cac1648dadb7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:57.880295 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-92d39162-aa30-42f0-874f-cac1648dadb7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:57.886644 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92d39162-aa30-42f0-874f-cac1648dadb7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:57.887119 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92d39162-aa30-42f0-874f-cac1648dadb7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:57.887550 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92d39162-aa30-42f0-874f-cac1648dadb7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:57.888231 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92d39162-aa30-42f0-874f-cac1648dadb7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:57.888678 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92d39162-aa30-42f0-874f-cac1648dadb7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:57.889130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-92d39162-aa30-42f0-874f-cac1648dadb7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:58.014888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-92d39162-aa30-42f0-874f-cac1648dadb7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:58.023512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-92d39162-aa30-42f0-874f-cac1648dadb7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1723 microversion: 2.1 time: 0.147774 Sep 20 22:27:58.024080 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 247/514] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:57 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:27:59.047251 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4a4d5149-79b4-44ae-9b37-739f6841f4bb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:27:59.047889 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4a4d5149-79b4-44ae-9b37-739f6841f4bb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:27:59.054850 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4a4d5149-79b4-44ae-9b37-739f6841f4bb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:59.055329 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4a4d5149-79b4-44ae-9b37-739f6841f4bb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:59.055764 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4a4d5149-79b4-44ae-9b37-739f6841f4bb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:59.056446 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4a4d5149-79b4-44ae-9b37-739f6841f4bb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:27:59.056898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4a4d5149-79b4-44ae-9b37-739f6841f4bb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:27:59.057347 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4a4d5149-79b4-44ae-9b37-739f6841f4bb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:27:59.186013 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4a4d5149-79b4-44ae-9b37-739f6841f4bb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:27:59.194150 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4a4d5149-79b4-44ae-9b37-739f6841f4bb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1723 microversion: 2.1 time: 0.151206 Sep 20 22:27:59.194703 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 268/515] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:27:59 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:00.218766 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-7111fd69-d661-4922-b536-0dae3957dbb5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:00.219410 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-7111fd69-d661-4922-b536-0dae3957dbb5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:00.225978 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7111fd69-d661-4922-b536-0dae3957dbb5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:00.226461 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7111fd69-d661-4922-b536-0dae3957dbb5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:00.226892 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7111fd69-d661-4922-b536-0dae3957dbb5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:00.227581 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7111fd69-d661-4922-b536-0dae3957dbb5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:00.228026 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7111fd69-d661-4922-b536-0dae3957dbb5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:00.228441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7111fd69-d661-4922-b536-0dae3957dbb5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:00.363659 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-7111fd69-d661-4922-b536-0dae3957dbb5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:00.372325 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-7111fd69-d661-4922-b536-0dae3957dbb5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1729 microversion: 2.1 time: 0.158987 Sep 20 22:28:00.372929 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 248/516] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:00 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:00.396812 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-e37ccfc2-e237-44f5-ac8a-f2395ec49205 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:00.397388 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-e37ccfc2-e237-44f5-ac8a-f2395ec49205 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:00.403723 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e37ccfc2-e237-44f5-ac8a-f2395ec49205 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:00.404204 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e37ccfc2-e237-44f5-ac8a-f2395ec49205 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:00.404630 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e37ccfc2-e237-44f5-ac8a-f2395ec49205 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:00.405355 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e37ccfc2-e237-44f5-ac8a-f2395ec49205 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:00.405791 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e37ccfc2-e237-44f5-ac8a-f2395ec49205 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:00.406205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e37ccfc2-e237-44f5-ac8a-f2395ec49205 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:00.484280 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-e37ccfc2-e237-44f5-ac8a-f2395ec49205 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091940 Sep 20 22:28:00.484910 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 269/517] 10.222.0.16 () {58 vars in 1275 bytes} [Tue Sep 20 22:28:00 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:28:00.922735 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d2193bd0-df48-4892-aa66-41d100b51d0c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:00.923234 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d2193bd0-df48-4892-aa66-41d100b51d0c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:00.929720 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d2193bd0-df48-4892-aa66-41d100b51d0c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:00.930212 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d2193bd0-df48-4892-aa66-41d100b51d0c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:00.930647 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d2193bd0-df48-4892-aa66-41d100b51d0c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:00.931341 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d2193bd0-df48-4892-aa66-41d100b51d0c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:00.931792 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d2193bd0-df48-4892-aa66-41d100b51d0c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:00.932216 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d2193bd0-df48-4892-aa66-41d100b51d0c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:00.957205 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d2193bd0-df48-4892-aa66-41d100b51d0c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Going to try to terminate instance {{(pid=120473) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:28:01.033851 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-d2193bd0-df48-4892-aa66-41d100b51d0c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "DELETE /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 204 len: 0 microversion: 2.1 time: 0.114651 Sep 20 22:28:01.034741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 249/518] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:28:00 2022] DELETE /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:28:01.044383 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-438fce3c-e64e-4cdf-a056-67003f35c3b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:01.045008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-438fce3c-e64e-4cdf-a056-67003f35c3b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:01.051696 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-438fce3c-e64e-4cdf-a056-67003f35c3b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:01.052178 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-438fce3c-e64e-4cdf-a056-67003f35c3b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:01.052601 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-438fce3c-e64e-4cdf-a056-67003f35c3b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:01.053312 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-438fce3c-e64e-4cdf-a056-67003f35c3b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:01.053762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-438fce3c-e64e-4cdf-a056-67003f35c3b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:01.054176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-438fce3c-e64e-4cdf-a056-67003f35c3b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:01.262808 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-438fce3c-e64e-4cdf-a056-67003f35c3b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:01.270819 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-438fce3c-e64e-4cdf-a056-67003f35c3b0 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1512 microversion: 2.1 time: 0.231394 Sep 20 22:28:01.271397 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 270/519] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:01 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1512 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:01.433138 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-865b0bdd-28d3-4a5f-a449-0d89b15ccf1f req-65c01a4d-7eaa-4719-9be8-b2d570460551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704f353f-861e-47cf-9625-7210f9f1f81e", "tag": "514d6b9b-bb67-4159-8746-002d9cc07694"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:01.443954 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-865b0bdd-28d3-4a5f-a449-0d89b15ccf1f req-65c01a4d-7eaa-4719-9be8-b2d570460551 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:01.444437 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-865b0bdd-28d3-4a5f-a449-0d89b15ccf1f req-65c01a4d-7eaa-4719-9be8-b2d570460551 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:01.444860 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-865b0bdd-28d3-4a5f-a449-0d89b15ccf1f req-65c01a4d-7eaa-4719-9be8-b2d570460551 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:01.456272 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-865b0bdd-28d3-4a5f-a449-0d89b15ccf1f req-65c01a4d-7eaa-4719-9be8-b2d570460551 service nova] Creating event network-changed:514d6b9b-bb67-4159-8746-002d9cc07694 for instance 704f353f-861e-47cf-9625-7210f9f1f81e on hv-cinder-85827 Sep 20 22:28:01.461360 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-865b0bdd-28d3-4a5f-a449-0d89b15ccf1f req-65c01a4d-7eaa-4719-9be8-b2d570460551 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032246 Sep 20 22:28:01.461947 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 250/520] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:28:02.293983 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ab3f5c73-aa66-4574-b22f-b89171933c40 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:02.294522 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ab3f5c73-aa66-4574-b22f-b89171933c40 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:02.300805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ab3f5c73-aa66-4574-b22f-b89171933c40 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:02.301841 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ab3f5c73-aa66-4574-b22f-b89171933c40 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:02.302270 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ab3f5c73-aa66-4574-b22f-b89171933c40 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:02.302945 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ab3f5c73-aa66-4574-b22f-b89171933c40 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:02.303393 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ab3f5c73-aa66-4574-b22f-b89171933c40 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:02.303810 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ab3f5c73-aa66-4574-b22f-b89171933c40 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:02.430676 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ab3f5c73-aa66-4574-b22f-b89171933c40 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:02.438252 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ab3f5c73-aa66-4574-b22f-b89171933c40 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1512 microversion: 2.1 time: 0.148167 Sep 20 22:28:02.438826 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 271/521] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:02 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:03.462361 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-56ac8099-d1a7-43a7-bbcd-e72296ebdce8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:03.463090 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-56ac8099-d1a7-43a7-bbcd-e72296ebdce8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:03.469561 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56ac8099-d1a7-43a7-bbcd-e72296ebdce8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:03.470057 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56ac8099-d1a7-43a7-bbcd-e72296ebdce8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:03.470530 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56ac8099-d1a7-43a7-bbcd-e72296ebdce8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:03.471264 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56ac8099-d1a7-43a7-bbcd-e72296ebdce8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:03.471757 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56ac8099-d1a7-43a7-bbcd-e72296ebdce8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:03.472184 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56ac8099-d1a7-43a7-bbcd-e72296ebdce8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:03.538069 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-56ac8099-d1a7-43a7-bbcd-e72296ebdce8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:03.545997 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-56ac8099-d1a7-43a7-bbcd-e72296ebdce8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 200 len: 1470 microversion: 2.1 time: 0.088757 Sep 20 22:28:03.546584 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 251/522] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:03 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 1470 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:03.585285 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-4ef8dfc1-e3e7-47af-9b45-b49aacdcb568 req-8b8e7104-6d30-4693-8e93-a58ba156c5bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704f353f-861e-47cf-9625-7210f9f1f81e", "tag": "514d6b9b-bb67-4159-8746-002d9cc07694"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:03.595415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-4ef8dfc1-e3e7-47af-9b45-b49aacdcb568 req-8b8e7104-6d30-4693-8e93-a58ba156c5bc service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:03.595895 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-4ef8dfc1-e3e7-47af-9b45-b49aacdcb568 req-8b8e7104-6d30-4693-8e93-a58ba156c5bc service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:03.596328 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-4ef8dfc1-e3e7-47af-9b45-b49aacdcb568 req-8b8e7104-6d30-4693-8e93-a58ba156c5bc service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:03.609939 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-4ef8dfc1-e3e7-47af-9b45-b49aacdcb568 req-8b8e7104-6d30-4693-8e93-a58ba156c5bc service nova] Creating event network-changed:514d6b9b-bb67-4159-8746-002d9cc07694 for instance 704f353f-861e-47cf-9625-7210f9f1f81e on hv-cinder-85827 Sep 20 22:28:03.615358 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-4ef8dfc1-e3e7-47af-9b45-b49aacdcb568 req-8b8e7104-6d30-4693-8e93-a58ba156c5bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033809 Sep 20 22:28:03.615955 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 272/523] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:28:04.569866 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-aeccb6ff-011b-4abd-b29f-e12551842f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:04.570495 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-aeccb6ff-011b-4abd-b29f-e12551842f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 78d574ff-9ba0-4414-9527-4348b7f319b1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:04.577233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-aeccb6ff-011b-4abd-b29f-e12551842f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:04.577784 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-aeccb6ff-011b-4abd-b29f-e12551842f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:04.578237 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-aeccb6ff-011b-4abd-b29f-e12551842f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:04.578951 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-aeccb6ff-011b-4abd-b29f-e12551842f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:04.579434 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-aeccb6ff-011b-4abd-b29f-e12551842f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:04.579880 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-aeccb6ff-011b-4abd-b29f-e12551842f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:04.593769 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-aeccb6ff-011b-4abd-b29f-e12551842f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] HTTP exception thrown: Instance 78d574ff-9ba0-4414-9527-4348b7f319b1 could not be found. Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-aeccb6ff-011b-4abd-b29f-e12551842f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Request method failure captured: Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 HTTP/1.1 Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj4rE8aTk9XQilv-xRSuCCl42yNXtAKGVbxETAq7nWHmpkLlmB4KH7Gm3XQGfs7RzSsK_Yd0_bq3gz-4xynpox_1o_EZN7qRIFjBEbrbfd1f45poTqziIk5ROYUkOwak_2M8SWBYFsceH4og2kwr7w82Aa_o_TIy5ezfOQXvK_9SV9I Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: bef004c556b540e28aafe07418fe8e30 Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-VolumesSnapshotTestJSON-576134153 Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:28:04.595441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:28:04.596912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bef004c556b540e28aafe07418fe8e30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bef004c556b540e28aafe07418fe8e30", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bef004c556b540e28aafe07418fe8e30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bef004c556b540e28aafe07418fe8e30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:28:04.596912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-VolumesSnapshotTestJSON-576134153 Sep 20 22:28:04.596912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: bef004c556b540e28aafe07418fe8e30 Sep 20 22:28:04.596912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-576134153 Sep 20 22:28:04.596912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-VolumesSnapshotTestJSON-576134153-project Sep 20 22:28:04.596912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:28:04.596912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:28:04.596912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 427aa58e5bb74f65afa75037c9e70f80 Sep 20 22:28:04.596912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-VolumesSnapshotTestJSON-576134153-project Sep 20 22:28:04.596912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:28:04.596912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance 78d574ff-9ba0-4414-9527-4348b7f319b1 could not be found. Sep 20 22:28:04.596912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': '78d574ff-9ba0-4414-9527-4348b7f319b1'} Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78d574ff-9ba0-4414-9527-4348b7f319b1 could not be found. Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:28:04.597940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:28:04.599848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:28:04.599848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:28:04.599848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:28:04.599848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:28:04.599848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:28:04.599848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:28:04.599848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:28:04.599848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78d574ff-9ba0-4414-9527-4348b7f319b1 could not be found. Sep 20 22:28:04.599848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:04.599848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:28:04.599848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:04.599848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:28:04.599848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:28:04.599848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:28:04.599848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:28:04.599848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:28:04.599848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78d574ff-9ba0-4414-9527-4348b7f319b1 could not be found. Sep 20 22:28:04.599848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:04.601136 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-aeccb6ff-011b-4abd-b29f-e12551842f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Returning 404 to user: Instance 78d574ff-9ba0-4414-9527-4348b7f319b1 could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:28:04.601136 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-aeccb6ff-011b-4abd-b29f-e12551842f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1" status: 404 len: 111 microversion: 2.1 time: 0.031107 Sep 20 22:28:04.601136 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 252/524] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:04 2022] GET /compute/v2.1/servers/78d574ff-9ba0-4414-9527-4348b7f319b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:28:04.744131 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c71b4f48-c14a-4a56-b7e9-46bde7789c75 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:04.744730 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-c71b4f48-c14a-4a56-b7e9-46bde7789c75 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:04.757099 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c71b4f48-c14a-4a56-b7e9-46bde7789c75 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:04.757099 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c71b4f48-c14a-4a56-b7e9-46bde7789c75 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:04.757099 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c71b4f48-c14a-4a56-b7e9-46bde7789c75 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:04.757099 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c71b4f48-c14a-4a56-b7e9-46bde7789c75 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:04.757491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c71b4f48-c14a-4a56-b7e9-46bde7789c75 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:04.757491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c71b4f48-c14a-4a56-b7e9-46bde7789c75 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:04.793749 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c71b4f48-c14a-4a56-b7e9-46bde7789c75 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/os-volume_attachments/411488ba-a37d-4582-9d90-3635ed107124" status: 200 len: 194 microversion: 2.20 time: 0.054449 Sep 20 22:28:04.794390 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 273/525] 10.222.0.16 () {60 vars in 1454 bytes} [Tue Sep 20 22:28:04 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/os-volume_attachments/411488ba-a37d-4582-9d90-3635ed107124 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:28:04.863705 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-2d44455b-0d88-4102-bbc9-9eba31bdd8ef tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:04.864205 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-2d44455b-0d88-4102-bbc9-9eba31bdd8ef tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:04.870814 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2d44455b-0d88-4102-bbc9-9eba31bdd8ef tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:04.871382 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2d44455b-0d88-4102-bbc9-9eba31bdd8ef tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:04.871880 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2d44455b-0d88-4102-bbc9-9eba31bdd8ef tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:04.872698 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2d44455b-0d88-4102-bbc9-9eba31bdd8ef tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:04.873194 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2d44455b-0d88-4102-bbc9-9eba31bdd8ef tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:04.873649 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2d44455b-0d88-4102-bbc9-9eba31bdd8ef tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:04.954452 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-2d44455b-0d88-4102-bbc9-9eba31bdd8ef tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lazy-loading 'services' on Instance uuid 48d58779-65b7-4b97-8536-eef4357a475d {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:28:05.065663 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-2d44455b-0d88-4102-bbc9-9eba31bdd8ef tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "DELETE /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/os-volume_attachments/411488ba-a37d-4582-9d90-3635ed107124" status: 202 len: 0 microversion: 2.20 time: 0.205703 Sep 20 22:28:05.066258 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 253/526] 10.222.0.16 () {60 vars in 1457 bytes} [Tue Sep 20 22:28:04 2022] DELETE /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/os-volume_attachments/411488ba-a37d-4582-9d90-3635ed107124 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:28:05.075362 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b6109b8c-3818-4453-ba54-74e17e415727 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:05.077709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b6109b8c-3818-4453-ba54-74e17e415727 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:05.084424 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b6109b8c-3818-4453-ba54-74e17e415727 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:05.084911 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b6109b8c-3818-4453-ba54-74e17e415727 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:05.085389 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b6109b8c-3818-4453-ba54-74e17e415727 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:05.086111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b6109b8c-3818-4453-ba54-74e17e415727 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:05.086655 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b6109b8c-3818-4453-ba54-74e17e415727 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:05.087084 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b6109b8c-3818-4453-ba54-74e17e415727 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:05.115951 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b6109b8c-3818-4453-ba54-74e17e415727 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044745 Sep 20 22:28:05.116767 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 274/527] 10.222.0.16 () {60 vars in 1343 bytes} [Tue Sep 20 22:28:05 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:28:05.632065 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-bb5421ba-d909-4008-8aa9-af868429637c req-5db66a0f-5110-430b-91a8-e171565fe2fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78d574ff-9ba0-4414-9527-4348b7f319b1", "name": "network-vif-deleted", "tag": "9d9ce120-05ea-4d90-a0c6-fe7b78bb0049"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:05.641523 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-bb5421ba-d909-4008-8aa9-af868429637c req-5db66a0f-5110-430b-91a8-e171565fe2fc service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:05.641992 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-bb5421ba-d909-4008-8aa9-af868429637c req-5db66a0f-5110-430b-91a8-e171565fe2fc service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:05.642414 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-bb5421ba-d909-4008-8aa9-af868429637c req-5db66a0f-5110-430b-91a8-e171565fe2fc service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:05.653520 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-bb5421ba-d909-4008-8aa9-af868429637c req-5db66a0f-5110-430b-91a8-e171565fe2fc service nova] Creating event network-vif-deleted:9d9ce120-05ea-4d90-a0c6-fe7b78bb0049 for instance 78d574ff-9ba0-4414-9527-4348b7f319b1 on hv-cinder-85827 Sep 20 22:28:05.658164 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-bb5421ba-d909-4008-8aa9-af868429637c req-5db66a0f-5110-430b-91a8-e171565fe2fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031342 Sep 20 22:28:05.658722 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 254/528] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:28:06.129854 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f9c05952-8f15-4d5e-af73-8bfb3e68c56f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:06.131924 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-f9c05952-8f15-4d5e-af73-8bfb3e68c56f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:06.138282 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f9c05952-8f15-4d5e-af73-8bfb3e68c56f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:06.138754 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f9c05952-8f15-4d5e-af73-8bfb3e68c56f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:06.139178 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f9c05952-8f15-4d5e-af73-8bfb3e68c56f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:06.139848 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f9c05952-8f15-4d5e-af73-8bfb3e68c56f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:06.140291 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f9c05952-8f15-4d5e-af73-8bfb3e68c56f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:06.140707 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f9c05952-8f15-4d5e-af73-8bfb3e68c56f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:06.168419 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-f9c05952-8f15-4d5e-af73-8bfb3e68c56f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043388 Sep 20 22:28:06.168963 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 275/529] 10.222.0.16 () {60 vars in 1343 bytes} [Tue Sep 20 22:28:06 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:28:07.182687 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b9c9bebf-e915-4701-9cb1-1ae96a5dba55 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:07.184935 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b9c9bebf-e915-4701-9cb1-1ae96a5dba55 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:07.186876 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:07.194297 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b9c9bebf-e915-4701-9cb1-1ae96a5dba55 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:07.195138 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b9c9bebf-e915-4701-9cb1-1ae96a5dba55 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:07.195682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b9c9bebf-e915-4701-9cb1-1ae96a5dba55 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:07.196497 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b9c9bebf-e915-4701-9cb1-1ae96a5dba55 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:07.197187 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b9c9bebf-e915-4701-9cb1-1ae96a5dba55 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:07.197623 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b9c9bebf-e915-4701-9cb1-1ae96a5dba55 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:07.228617 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b9c9bebf-e915-4701-9cb1-1ae96a5dba55 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050820 Sep 20 22:28:07.229201 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 255/530] 10.222.0.16 () {60 vars in 1343 bytes} [Tue Sep 20 22:28:07 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 20 22:28:08.241160 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-21d2dbfb-8530-4562-8849-f7208c8da17a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:08.243554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-21d2dbfb-8530-4562-8849-f7208c8da17a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:08.250030 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-21d2dbfb-8530-4562-8849-f7208c8da17a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:08.250517 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-21d2dbfb-8530-4562-8849-f7208c8da17a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:08.250950 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-21d2dbfb-8530-4562-8849-f7208c8da17a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:08.251640 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-21d2dbfb-8530-4562-8849-f7208c8da17a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:08.252094 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-21d2dbfb-8530-4562-8849-f7208c8da17a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:08.252546 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-21d2dbfb-8530-4562-8849-f7208c8da17a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:08.281834 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-21d2dbfb-8530-4562-8849-f7208c8da17a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045388 Sep 20 22:28:08.282407 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 276/531] 10.222.0.16 () {60 vars in 1343 bytes} [Tue Sep 20 22:28:08 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:28:09.294934 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-44e5cba6-b664-4588-aa38-21c68216e614 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:09.297075 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-44e5cba6-b664-4588-aa38-21c68216e614 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:09.303574 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-44e5cba6-b664-4588-aa38-21c68216e614 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:09.304052 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-44e5cba6-b664-4588-aa38-21c68216e614 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:09.304481 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-44e5cba6-b664-4588-aa38-21c68216e614 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:09.305191 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-44e5cba6-b664-4588-aa38-21c68216e614 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:09.305665 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-44e5cba6-b664-4588-aa38-21c68216e614 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:09.306055 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-44e5cba6-b664-4588-aa38-21c68216e614 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:09.334612 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-44e5cba6-b664-4588-aa38-21c68216e614 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043664 Sep 20 22:28:09.335169 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 256/532] 10.222.0.16 () {60 vars in 1343 bytes} [Tue Sep 20 22:28:09 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:09.398828 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-14428d61-18e3-4af1-826c-23eadaa970ea tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:09.399315 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-14428d61-18e3-4af1-826c-23eadaa970ea tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:09.405680 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-14428d61-18e3-4af1-826c-23eadaa970ea tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:09.406156 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-14428d61-18e3-4af1-826c-23eadaa970ea tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:09.406586 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-14428d61-18e3-4af1-826c-23eadaa970ea tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:09.407263 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-14428d61-18e3-4af1-826c-23eadaa970ea tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:09.407709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-14428d61-18e3-4af1-826c-23eadaa970ea tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:09.408125 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-14428d61-18e3-4af1-826c-23eadaa970ea tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:09.434177 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-14428d61-18e3-4af1-826c-23eadaa970ea tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Going to try to terminate instance {{(pid=120474) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:28:09.448953 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:09.511947 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-14428d61-18e3-4af1-826c-23eadaa970ea tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "DELETE /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 204 len: 0 microversion: 2.20 time: 0.116999 Sep 20 22:28:09.512773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 277/533] 10.222.0.16 () {60 vars in 1280 bytes} [Tue Sep 20 22:28:09 2022] DELETE /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 20 22:28:09.522527 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-69941a5a-d68f-412f-a962-00b88cea189a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:09.523199 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-69941a5a-d68f-412f-a962-00b88cea189a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:09.529000 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-69941a5a-d68f-412f-a962-00b88cea189a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:09.529502 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-69941a5a-d68f-412f-a962-00b88cea189a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:09.529936 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-69941a5a-d68f-412f-a962-00b88cea189a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:09.530617 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-69941a5a-d68f-412f-a962-00b88cea189a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:09.531068 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-69941a5a-d68f-412f-a962-00b88cea189a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:09.531488 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-69941a5a-d68f-412f-a962-00b88cea189a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:09.658420 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-69941a5a-d68f-412f-a962-00b88cea189a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:09.666423 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-69941a5a-d68f-412f-a962-00b88cea189a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:09.667863 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-69941a5a-d68f-412f-a962-00b88cea189a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:09.669031 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-69941a5a-d68f-412f-a962-00b88cea189a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.151180 Sep 20 22:28:09.669596 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 257/534] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:09 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:28:10.694819 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c1838b84-8e29-4777-9154-2224484a450a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:10.695509 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-c1838b84-8e29-4777-9154-2224484a450a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:10.701900 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c1838b84-8e29-4777-9154-2224484a450a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:10.702370 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c1838b84-8e29-4777-9154-2224484a450a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:10.702793 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c1838b84-8e29-4777-9154-2224484a450a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:10.703463 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c1838b84-8e29-4777-9154-2224484a450a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:10.703903 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c1838b84-8e29-4777-9154-2224484a450a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:10.704314 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c1838b84-8e29-4777-9154-2224484a450a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:10.833163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-c1838b84-8e29-4777-9154-2224484a450a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:10.841116 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-c1838b84-8e29-4777-9154-2224484a450a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:10.842571 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-c1838b84-8e29-4777-9154-2224484a450a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:10.843726 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c1838b84-8e29-4777-9154-2224484a450a tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.153156 Sep 20 22:28:10.844285 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 278/535] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:10 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:28:11.870115 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-12ae845f-150f-45e7-b518-02398ff4be31 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:11.870752 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-12ae845f-150f-45e7-b518-02398ff4be31 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:11.877257 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-12ae845f-150f-45e7-b518-02398ff4be31 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:11.877723 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-12ae845f-150f-45e7-b518-02398ff4be31 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:11.878157 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-12ae845f-150f-45e7-b518-02398ff4be31 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:11.878865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-12ae845f-150f-45e7-b518-02398ff4be31 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:11.879318 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-12ae845f-150f-45e7-b518-02398ff4be31 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:11.879734 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-12ae845f-150f-45e7-b518-02398ff4be31 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:12.009521 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-12ae845f-150f-45e7-b518-02398ff4be31 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:12.017411 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-12ae845f-150f-45e7-b518-02398ff4be31 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:12.018853 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-12ae845f-150f-45e7-b518-02398ff4be31 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:12.020433 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-12ae845f-150f-45e7-b518-02398ff4be31 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.154544 Sep 20 22:28:12.021009 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 258/536] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:11 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:28:12.293907 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-50965f1b-9010-45b4-ab0d-2c0a033de98b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:12.296136 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-50965f1b-9010-45b4-ab0d-2c0a033de98b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:12.302562 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-50965f1b-9010-45b4-ab0d-2c0a033de98b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:12.303047 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-50965f1b-9010-45b4-ab0d-2c0a033de98b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:12.303482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-50965f1b-9010-45b4-ab0d-2c0a033de98b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:12.304170 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-50965f1b-9010-45b4-ab0d-2c0a033de98b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:12.304626 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-50965f1b-9010-45b4-ab0d-2c0a033de98b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:12.305077 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-50965f1b-9010-45b4-ab0d-2c0a033de98b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:12.334796 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-50965f1b-9010-45b4-ab0d-2c0a033de98b tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044728 Sep 20 22:28:12.335416 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 279/537] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:28:12 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 20 22:28:12.402258 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-3af334f4-c38c-45f5-9e2b-cf4b0374ceb8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-136099133", "imageRef": "a1be001e-c2e4-44b7-b0d2-af96de3855c4", "flavorRef": "452", "networks": [{"uuid": "944b21fa-950f-457b-a018-244a7ad7e4ee"}]}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:12.407396 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5bec6cb1-abdb-4bda-9e13-974faee9587c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:12.407925 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5bec6cb1-abdb-4bda-9e13-974faee9587c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:12.414524 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5bec6cb1-abdb-4bda-9e13-974faee9587c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:12.415007 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5bec6cb1-abdb-4bda-9e13-974faee9587c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:12.415441 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5bec6cb1-abdb-4bda-9e13-974faee9587c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:12.416129 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5bec6cb1-abdb-4bda-9e13-974faee9587c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:12.416582 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5bec6cb1-abdb-4bda-9e13-974faee9587c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:12.417123 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5bec6cb1-abdb-4bda-9e13-974faee9587c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:12.444898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5bec6cb1-abdb-4bda-9e13-974faee9587c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Going to try to terminate instance {{(pid=120474) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:28:12.458585 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.network.neutron [None req-3af334f4-c38c-45f5-9e2b-cf4b0374ceb8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] validate_networks() for [('944b21fa-950f-457b-a018-244a7ad7e4ee', None, None, None, None, None)] {{(pid=120473) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:28:12.521261 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5bec6cb1-abdb-4bda-9e13-974faee9587c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "DELETE /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 204 len: 0 microversion: 2.1 time: 0.117608 Sep 20 22:28:12.521768 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 280/538] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:28:12 2022] DELETE /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 20 22:28:12.530012 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b11bcd8a-b9f5-4432-8c71-417a05c08fa3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:12.530705 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b11bcd8a-b9f5-4432-8c71-417a05c08fa3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:12.536343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b11bcd8a-b9f5-4432-8c71-417a05c08fa3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:12.536938 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b11bcd8a-b9f5-4432-8c71-417a05c08fa3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:12.537465 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b11bcd8a-b9f5-4432-8c71-417a05c08fa3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:12.538155 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b11bcd8a-b9f5-4432-8c71-417a05c08fa3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:12.538681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b11bcd8a-b9f5-4432-8c71-417a05c08fa3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:12.539016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b11bcd8a-b9f5-4432-8c71-417a05c08fa3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:12.671367 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b11bcd8a-b9f5-4432-8c71-417a05c08fa3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:12.679067 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b11bcd8a-b9f5-4432-8c71-417a05c08fa3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1673 microversion: 2.1 time: 0.153010 Sep 20 22:28:12.679823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 281/539] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:12 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:13.046410 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-50c5b6bd-546f-45ee-acbd-a75c34c7b34c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:13.047869 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-50c5b6bd-546f-45ee-acbd-a75c34c7b34c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:13.049157 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-3af334f4-c38c-45f5-9e2b-cf4b0374ceb8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Flavor limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:28:13.050174 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-3af334f4-c38c-45f5-9e2b-cf4b0374ceb8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Image limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:28:13.051355 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-3af334f4-c38c-45f5-9e2b-cf4b0374ceb8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Flavor pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:28:13.051981 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-3af334f4-c38c-45f5-9e2b-cf4b0374ceb8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Image pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:28:13.052553 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-3af334f4-c38c-45f5-9e2b-cf4b0374ceb8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:28:13.054383 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-50c5b6bd-546f-45ee-acbd-a75c34c7b34c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:13.054853 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-50c5b6bd-546f-45ee-acbd-a75c34c7b34c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:13.055283 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-50c5b6bd-546f-45ee-acbd-a75c34c7b34c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:13.056184 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-50c5b6bd-546f-45ee-acbd-a75c34c7b34c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:13.056447 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-50c5b6bd-546f-45ee-acbd-a75c34c7b34c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:13.056870 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-50c5b6bd-546f-45ee-acbd-a75c34c7b34c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:13.062532 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3af334f4-c38c-45f5-9e2b-cf4b0374ceb8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:13.063016 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3af334f4-c38c-45f5-9e2b-cf4b0374ceb8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:13.063449 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3af334f4-c38c-45f5-9e2b-cf4b0374ceb8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:13.064175 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3af334f4-c38c-45f5-9e2b-cf4b0374ceb8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:13.064628 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3af334f4-c38c-45f5-9e2b-cf4b0374ceb8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:13.065084 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3af334f4-c38c-45f5-9e2b-cf4b0374ceb8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:13.083249 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-3af334f4-c38c-45f5-9e2b-cf4b0374ceb8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Getting quotas for project bef004c556b540e28aafe07418fe8e30. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:28:13.087161 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-3af334f4-c38c-45f5-9e2b-cf4b0374ceb8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Getting quotas for user 427aa58e5bb74f65afa75037c9e70f80 and project bef004c556b540e28aafe07418fe8e30. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:28:13.098187 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-3af334f4-c38c-45f5-9e2b-cf4b0374ceb8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Going to run 1 instances... {{(pid=120473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:28:13.100530 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-3af334f4-c38c-45f5-9e2b-cf4b0374ceb8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a1be001e-c2e4-44b7-b0d2-af96de3855c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:28:13.149621 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-3af334f4-c38c-45f5-9e2b-cf4b0374ceb8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751325 Sep 20 22:28:13.150991 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 259/540] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:28:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 22:28:13.162373 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-20343e02-318b-48eb-9b93-a1493c7ada3c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:13.163308 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-20343e02-318b-48eb-9b93-a1493c7ada3c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:13.206408 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-50c5b6bd-546f-45ee-acbd-a75c34c7b34c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:13.226018 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-50c5b6bd-546f-45ee-acbd-a75c34c7b34c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:13.227478 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-50c5b6bd-546f-45ee-acbd-a75c34c7b34c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:13.229285 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-50c5b6bd-546f-45ee-acbd-a75c34c7b34c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.186517 Sep 20 22:28:13.245154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 282/541] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:13 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:28:13.247707 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-20343e02-318b-48eb-9b93-a1493c7ada3c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:13.255695 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-20343e02-318b-48eb-9b93-a1493c7ada3c tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 200 len: 1218 microversion: 2.1 time: 0.098025 Sep 20 22:28:13.256300 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 260/542] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:13 2022] GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:13.702541 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b6029a46-4270-4f1b-ac8a-a971217fb514 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:13.703094 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b6029a46-4270-4f1b-ac8a-a971217fb514 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:13.710018 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b6029a46-4270-4f1b-ac8a-a971217fb514 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:13.710493 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b6029a46-4270-4f1b-ac8a-a971217fb514 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:13.710923 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b6029a46-4270-4f1b-ac8a-a971217fb514 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:13.711602 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b6029a46-4270-4f1b-ac8a-a971217fb514 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:13.712049 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b6029a46-4270-4f1b-ac8a-a971217fb514 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:13.712464 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b6029a46-4270-4f1b-ac8a-a971217fb514 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:13.837134 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b6029a46-4270-4f1b-ac8a-a971217fb514 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:13.844658 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b6029a46-4270-4f1b-ac8a-a971217fb514 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1673 microversion: 2.1 time: 0.146054 Sep 20 22:28:13.845254 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 283/543] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:13 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1673 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:14.256629 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b453fe61-f1e1-4360-b6b3-d893c561c29c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:14.257262 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b453fe61-f1e1-4360-b6b3-d893c561c29c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:14.263641 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b453fe61-f1e1-4360-b6b3-d893c561c29c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:14.264110 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b453fe61-f1e1-4360-b6b3-d893c561c29c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:14.264543 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b453fe61-f1e1-4360-b6b3-d893c561c29c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:14.265259 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b453fe61-f1e1-4360-b6b3-d893c561c29c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:14.265711 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b453fe61-f1e1-4360-b6b3-d893c561c29c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:14.266129 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b453fe61-f1e1-4360-b6b3-d893c561c29c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:14.277915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-27a664b9-89ec-4080-b9cd-fa764791f60a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:14.278673 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-27a664b9-89ec-4080-b9cd-fa764791f60a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:14.284578 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-27a664b9-89ec-4080-b9cd-fa764791f60a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:14.285636 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-27a664b9-89ec-4080-b9cd-fa764791f60a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:14.286076 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-27a664b9-89ec-4080-b9cd-fa764791f60a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:14.286760 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-27a664b9-89ec-4080-b9cd-fa764791f60a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:14.287210 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-27a664b9-89ec-4080-b9cd-fa764791f60a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:14.287629 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-27a664b9-89ec-4080-b9cd-fa764791f60a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:14.352283 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-27a664b9-89ec-4080-b9cd-fa764791f60a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:14.359941 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-27a664b9-89ec-4080-b9cd-fa764791f60a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 200 len: 1222 microversion: 2.1 time: 0.085891 Sep 20 22:28:14.360509 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 284/544] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:14 2022] GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:14.393894 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b453fe61-f1e1-4360-b6b3-d893c561c29c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:14.402416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b453fe61-f1e1-4360-b6b3-d893c561c29c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:14.403853 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b453fe61-f1e1-4360-b6b3-d893c561c29c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:14.404998 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b453fe61-f1e1-4360-b6b3-d893c561c29c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.152266 Sep 20 22:28:14.405622 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 261/545] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:14 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:28:14.868622 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a2f6363f-47fe-4292-8f50-7bca68530fb4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:14.869258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a2f6363f-47fe-4292-8f50-7bca68530fb4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:14.875679 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a2f6363f-47fe-4292-8f50-7bca68530fb4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:14.876169 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a2f6363f-47fe-4292-8f50-7bca68530fb4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:14.876602 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a2f6363f-47fe-4292-8f50-7bca68530fb4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:14.877326 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a2f6363f-47fe-4292-8f50-7bca68530fb4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:14.877782 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a2f6363f-47fe-4292-8f50-7bca68530fb4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:14.878201 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a2f6363f-47fe-4292-8f50-7bca68530fb4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:15.003591 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a2f6363f-47fe-4292-8f50-7bca68530fb4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:15.011693 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a2f6363f-47fe-4292-8f50-7bca68530fb4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1673 microversion: 2.1 time: 0.147369 Sep 20 22:28:15.012255 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 285/546] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:14 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:15.384713 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-90b9229b-06fc-490b-8a1d-15aed41a35f9 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:15.385354 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-90b9229b-06fc-490b-8a1d-15aed41a35f9 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:15.391675 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-90b9229b-06fc-490b-8a1d-15aed41a35f9 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:15.392184 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-90b9229b-06fc-490b-8a1d-15aed41a35f9 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:15.392614 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-90b9229b-06fc-490b-8a1d-15aed41a35f9 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:15.393336 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-90b9229b-06fc-490b-8a1d-15aed41a35f9 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:15.393782 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-90b9229b-06fc-490b-8a1d-15aed41a35f9 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:15.394201 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-90b9229b-06fc-490b-8a1d-15aed41a35f9 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:15.398156 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:15.431329 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-929b6fc5-3ce0-43f3-89b3-28bd81e5aad6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:15.432127 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-929b6fc5-3ce0-43f3-89b3-28bd81e5aad6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:15.439583 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-929b6fc5-3ce0-43f3-89b3-28bd81e5aad6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:15.440048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-929b6fc5-3ce0-43f3-89b3-28bd81e5aad6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:15.440549 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-929b6fc5-3ce0-43f3-89b3-28bd81e5aad6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:15.441942 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-929b6fc5-3ce0-43f3-89b3-28bd81e5aad6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:15.442403 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-929b6fc5-3ce0-43f3-89b3-28bd81e5aad6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:15.442824 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-929b6fc5-3ce0-43f3-89b3-28bd81e5aad6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:15.461132 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-90b9229b-06fc-490b-8a1d-15aed41a35f9 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:15.470331 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-90b9229b-06fc-490b-8a1d-15aed41a35f9 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 200 len: 1222 microversion: 2.1 time: 0.090230 Sep 20 22:28:15.470905 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 262/547] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:15 2022] GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:15.581650 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-929b6fc5-3ce0-43f3-89b3-28bd81e5aad6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:15.591215 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-929b6fc5-3ce0-43f3-89b3-28bd81e5aad6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:15.592758 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-929b6fc5-3ce0-43f3-89b3-28bd81e5aad6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:15.593987 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-929b6fc5-3ce0-43f3-89b3-28bd81e5aad6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1723 microversion: 2.20 time: 0.166647 Sep 20 22:28:15.594531 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 286/548] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:15 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:28:16.040159 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-9e9ac6f0-3195-4b86-ab02-cac4f1654e93 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:16.041074 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-9e9ac6f0-3195-4b86-ab02-cac4f1654e93 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:16.047795 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9e9ac6f0-3195-4b86-ab02-cac4f1654e93 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:16.048408 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9e9ac6f0-3195-4b86-ab02-cac4f1654e93 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:16.048910 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9e9ac6f0-3195-4b86-ab02-cac4f1654e93 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:16.050643 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9e9ac6f0-3195-4b86-ab02-cac4f1654e93 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:16.051192 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9e9ac6f0-3195-4b86-ab02-cac4f1654e93 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:16.051676 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9e9ac6f0-3195-4b86-ab02-cac4f1654e93 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:16.258241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-9e9ac6f0-3195-4b86-ab02-cac4f1654e93 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:16.271284 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-9e9ac6f0-3195-4b86-ab02-cac4f1654e93 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1673 microversion: 2.1 time: 0.239669 Sep 20 22:28:16.272183 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 263/549] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:16 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1673 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:16.496239 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a0c8fced-ac45-42eb-9fac-a3b325f39dc8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:16.496806 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a0c8fced-ac45-42eb-9fac-a3b325f39dc8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:16.522082 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a0c8fced-ac45-42eb-9fac-a3b325f39dc8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:16.522758 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a0c8fced-ac45-42eb-9fac-a3b325f39dc8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:16.526706 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a0c8fced-ac45-42eb-9fac-a3b325f39dc8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:16.528107 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a0c8fced-ac45-42eb-9fac-a3b325f39dc8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:16.528587 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a0c8fced-ac45-42eb-9fac-a3b325f39dc8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:16.529202 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a0c8fced-ac45-42eb-9fac-a3b325f39dc8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:16.551734 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-30fb1ac8-b172-4eb2-98e4-a941f1adc1bd req-cfa16945-9200-4fc6-bd25-3a949036992b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d58779-65b7-4b97-8536-eef4357a475d", "name": "network-vif-deleted", "tag": "d965769d-834a-4b9f-817a-24e086032c2d"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:16.565608 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-30fb1ac8-b172-4eb2-98e4-a941f1adc1bd req-cfa16945-9200-4fc6-bd25-3a949036992b service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:16.571665 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-30fb1ac8-b172-4eb2-98e4-a941f1adc1bd req-cfa16945-9200-4fc6-bd25-3a949036992b service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:16.572279 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-30fb1ac8-b172-4eb2-98e4-a941f1adc1bd req-cfa16945-9200-4fc6-bd25-3a949036992b service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:16.586450 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-30fb1ac8-b172-4eb2-98e4-a941f1adc1bd req-cfa16945-9200-4fc6-bd25-3a949036992b service nova] Creating event network-vif-deleted:d965769d-834a-4b9f-817a-24e086032c2d for instance 48d58779-65b7-4b97-8536-eef4357a475d on hv-cinder-85827 Sep 20 22:28:16.592911 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-30fb1ac8-b172-4eb2-98e4-a941f1adc1bd req-cfa16945-9200-4fc6-bd25-3a949036992b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045114 Sep 20 22:28:16.594665 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 264/550] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:28:16.624071 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-1cfe6a3c-696c-4284-a13a-ae6aac3d2a89 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:16.625439 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-1cfe6a3c-696c-4284-a13a-ae6aac3d2a89 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:16.634453 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1cfe6a3c-696c-4284-a13a-ae6aac3d2a89 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:16.635238 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1cfe6a3c-696c-4284-a13a-ae6aac3d2a89 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:16.636183 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1cfe6a3c-696c-4284-a13a-ae6aac3d2a89 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:16.639618 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1cfe6a3c-696c-4284-a13a-ae6aac3d2a89 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:16.640380 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1cfe6a3c-696c-4284-a13a-ae6aac3d2a89 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:16.641141 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1cfe6a3c-696c-4284-a13a-ae6aac3d2a89 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:16.657968 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a0c8fced-ac45-42eb-9fac-a3b325f39dc8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:16.666683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a0c8fced-ac45-42eb-9fac-a3b325f39dc8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 200 len: 1276 microversion: 2.1 time: 0.176228 Sep 20 22:28:16.681459 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 287/551] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:16 2022] GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 1276 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:16.751193 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-1cfe6a3c-696c-4284-a13a-ae6aac3d2a89 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:16.770980 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-1cfe6a3c-696c-4284-a13a-ae6aac3d2a89 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:16.773543 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-1cfe6a3c-696c-4284-a13a-ae6aac3d2a89 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:16.774901 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-1cfe6a3c-696c-4284-a13a-ae6aac3d2a89 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 200 len: 1367 microversion: 2.20 time: 0.158278 Sep 20 22:28:16.789142 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 265/552] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:16 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:28:17.079749 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-31892886-4c13-4dbf-966f-2603350c4800 req-e0c2cac2-4c42-4623-9e62-c6eaa8f49e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89747cc8-0eba-4b3b-8fec-ec0663bc51d0", "name": "network-vif-deleted", "tag": "beceeb78-fe70-47d6-98db-538612768bf8"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:17.100949 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-31892886-4c13-4dbf-966f-2603350c4800 req-e0c2cac2-4c42-4623-9e62-c6eaa8f49e9e service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:17.101467 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-31892886-4c13-4dbf-966f-2603350c4800 req-e0c2cac2-4c42-4623-9e62-c6eaa8f49e9e service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:17.101902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-31892886-4c13-4dbf-966f-2603350c4800 req-e0c2cac2-4c42-4623-9e62-c6eaa8f49e9e service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:17.135535 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-31892886-4c13-4dbf-966f-2603350c4800 req-e0c2cac2-4c42-4623-9e62-c6eaa8f49e9e service nova] Creating event network-vif-deleted:beceeb78-fe70-47d6-98db-538612768bf8 for instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 on hv-cinder-85827 Sep 20 22:28:17.142732 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-31892886-4c13-4dbf-966f-2603350c4800 req-e0c2cac2-4c42-4623-9e62-c6eaa8f49e9e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068655 Sep 20 22:28:17.145311 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 288/553] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:28:17.299942 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c13960ab-79b7-4b89-8111-17a0a56b4955 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:17.302592 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c13960ab-79b7-4b89-8111-17a0a56b4955 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:17.309778 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c13960ab-79b7-4b89-8111-17a0a56b4955 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:17.310769 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c13960ab-79b7-4b89-8111-17a0a56b4955 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:17.311473 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c13960ab-79b7-4b89-8111-17a0a56b4955 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:17.313130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c13960ab-79b7-4b89-8111-17a0a56b4955 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:17.313854 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c13960ab-79b7-4b89-8111-17a0a56b4955 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:17.314468 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c13960ab-79b7-4b89-8111-17a0a56b4955 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:17.356784 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c13960ab-79b7-4b89-8111-17a0a56b4955 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:17.357826 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c13960ab-79b7-4b89-8111-17a0a56b4955 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:17.358625 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c13960ab-79b7-4b89-8111-17a0a56b4955 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:17.359258 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-c13960ab-79b7-4b89-8111-17a0a56b4955 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lazy-loading 'fault' on Instance uuid 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:28:17.468305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c13960ab-79b7-4b89-8111-17a0a56b4955 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:17.478951 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-c13960ab-79b7-4b89-8111-17a0a56b4955 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 200 len: 1327 microversion: 2.1 time: 0.184262 Sep 20 22:28:17.481738 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 266/554] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:17 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 1327 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:17.693796 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a6e52001-c720-4bf0-a5d1-c47a62f6b114 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:17.695128 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a6e52001-c720-4bf0-a5d1-c47a62f6b114 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:17.718367 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a6e52001-c720-4bf0-a5d1-c47a62f6b114 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:17.719205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a6e52001-c720-4bf0-a5d1-c47a62f6b114 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:17.720775 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a6e52001-c720-4bf0-a5d1-c47a62f6b114 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:17.725590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a6e52001-c720-4bf0-a5d1-c47a62f6b114 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:17.731668 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a6e52001-c720-4bf0-a5d1-c47a62f6b114 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:17.732165 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a6e52001-c720-4bf0-a5d1-c47a62f6b114 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:17.802405 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c1b3fadc-0bb3-4db2-8ff6-0a3d1fbfbd8b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:17.803027 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c1b3fadc-0bb3-4db2-8ff6-0a3d1fbfbd8b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:17.820834 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c1b3fadc-0bb3-4db2-8ff6-0a3d1fbfbd8b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:17.822251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c1b3fadc-0bb3-4db2-8ff6-0a3d1fbfbd8b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:17.824028 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c1b3fadc-0bb3-4db2-8ff6-0a3d1fbfbd8b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:17.825474 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c1b3fadc-0bb3-4db2-8ff6-0a3d1fbfbd8b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:17.826130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c1b3fadc-0bb3-4db2-8ff6-0a3d1fbfbd8b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:17.826673 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c1b3fadc-0bb3-4db2-8ff6-0a3d1fbfbd8b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:17.849606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-c1b3fadc-0bb3-4db2-8ff6-0a3d1fbfbd8b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] HTTP exception thrown: Instance 48d58779-65b7-4b97-8536-eef4357a475d could not be found. Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c1b3fadc-0bb3-4db2-8ff6-0a3d1fbfbd8b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Request method failure captured: Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d HTTP/1.1 Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj18syVDTaZWh7W51ZRKRb7NAdLaqAWn0_TI66AArVf0KyOeVdN9jJ1xQXel-um3xDw7PejpUUXU7wWaNaPTdS5rx_zamPaTjpnWIXNPBQRsMOtA7rMx0UUKlJVF91ITK-vT2WtQeF5k0Uolnnw406Dn4eI5JGv2TjN96CC1qhf2X_Y Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Openstack-Nova-Api-Version: 2.20 Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: 897090e72bcc4d978384c95688ab8021 Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-790319658 Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:28:17.855286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:28:17.856756 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/897090e72bcc4d978384c95688ab8021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_897090e72bcc4d978384c95688ab8021", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/897090e72bcc4d978384c95688ab8021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/897090e72bcc4d978384c95688ab8021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:28:17.856756 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-AttachVolumeShelveTestJSON-790319658 Sep 20 22:28:17.856756 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: 897090e72bcc4d978384c95688ab8021 Sep 20 22:28:17.856756 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-790319658 Sep 20 22:28:17.856756 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-AttachVolumeShelveTestJSON-790319658-project Sep 20 22:28:17.856756 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:28:17.856756 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:28:17.856756 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 69928e19721a455fb614c6f755495449 Sep 20 22:28:17.856756 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-AttachVolumeShelveTestJSON-790319658-project Sep 20 22:28:17.856756 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:28:17.856756 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance 48d58779-65b7-4b97-8536-eef4357a475d could not be found. Sep 20 22:28:17.856756 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': '48d58779-65b7-4b97-8536-eef4357a475d'} Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d58779-65b7-4b97-8536-eef4357a475d could not be found. Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:28:17.857544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:28:17.859014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:28:17.859014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:28:17.859014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:28:17.859014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:28:17.859014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:28:17.859014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:28:17.859014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:28:17.859014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d58779-65b7-4b97-8536-eef4357a475d could not be found. Sep 20 22:28:17.859014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:17.859014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:28:17.859014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:17.859014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:28:17.859014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:28:17.859014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:28:17.859014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:28:17.859014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:28:17.859014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d58779-65b7-4b97-8536-eef4357a475d could not be found. Sep 20 22:28:17.859014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:17.860068 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c1b3fadc-0bb3-4db2-8ff6-0a3d1fbfbd8b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Returning 404 to user: Instance 48d58779-65b7-4b97-8536-eef4357a475d could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:28:17.860068 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-c1b3fadc-0bb3-4db2-8ff6-0a3d1fbfbd8b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 404 len: 111 microversion: 2.20 time: 0.062519 Sep 20 22:28:17.860068 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 267/555] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:17 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 20 22:28:17.872546 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-e9ff0934-6962-431f-881a-a71338a5f884 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '.version_select at 0x7f24f69e6310>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:17.933688 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-e9ff0934-6962-431f-881a-a71338a5f884 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602590608" status: 204 len: 0 microversion: 2.20 time: 0.067683 Sep 20 22:28:17.934725 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 268/556] 10.222.0.16 () {60 vars in 1262 bytes} [Tue Sep 20 22:28:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602590608 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 20 22:28:17.986141 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a6e52001-c720-4bf0-a5d1-c47a62f6b114 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:17.995379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a6e52001-c720-4bf0-a5d1-c47a62f6b114 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 200 len: 1318 microversion: 2.1 time: 0.306494 Sep 20 22:28:18.014849 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 289/557] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:17 2022] GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:18.511019 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-fc9e99a2-3315-4fdc-ab59-323c50ec61b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:18.512679 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-fc9e99a2-3315-4fdc-ab59-323c50ec61b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:18.528168 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fc9e99a2-3315-4fdc-ab59-323c50ec61b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:18.528694 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fc9e99a2-3315-4fdc-ab59-323c50ec61b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:18.529182 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fc9e99a2-3315-4fdc-ab59-323c50ec61b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:18.529933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fc9e99a2-3315-4fdc-ab59-323c50ec61b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:18.530346 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fc9e99a2-3315-4fdc-ab59-323c50ec61b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:18.530860 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fc9e99a2-3315-4fdc-ab59-323c50ec61b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:18.551823 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-fc9e99a2-3315-4fdc-ab59-323c50ec61b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] HTTP exception thrown: Instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 could not be found. Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-fc9e99a2-3315-4fdc-ab59-323c50ec61b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Request method failure captured: Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 HTTP/1.1 Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj1u8Dac5LZoF9XvxzObiNZxaRtyHxJ9XJCPxEJUsZxCMmbYYjxZiqp8WdtamDDYfYrpvZPtB49n4OwOY35bDrutB_d1OI-gkcaYsYQhaL96sGaWU4DwbzLXaDsDWtPmcswXjUjTaYb7SdtEenwFZYFQiBG2KmA3RHtaz4ujsgmicSM Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: 02ff885440634a13916a25973bdde7b3 Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-AttachVolumeTestJSON-1455725482 Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:28:18.553416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:28:18.554664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02ff885440634a13916a25973bdde7b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_02ff885440634a13916a25973bdde7b3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/02ff885440634a13916a25973bdde7b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02ff885440634a13916a25973bdde7b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:28:18.554664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-AttachVolumeTestJSON-1455725482 Sep 20 22:28:18.554664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: 02ff885440634a13916a25973bdde7b3 Sep 20 22:28:18.554664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1455725482 Sep 20 22:28:18.554664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-AttachVolumeTestJSON-1455725482-project Sep 20 22:28:18.554664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:28:18.554664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:28:18.554664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: c45fbc2758e641fba97c0b3096db4f15 Sep 20 22:28:18.554664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-AttachVolumeTestJSON-1455725482-project Sep 20 22:28:18.554664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:28:18.554664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 could not be found. Sep 20 22:28:18.554664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': '89747cc8-0eba-4b3b-8fec-ec0663bc51d0'} Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 could not be found. Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:28:18.555404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:28:18.556987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:28:18.556987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:28:18.556987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:28:18.556987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:28:18.556987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:28:18.556987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:28:18.556987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:28:18.556987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 could not be found. Sep 20 22:28:18.556987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:18.556987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:28:18.556987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:18.556987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:28:18.556987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:28:18.556987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:28:18.556987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:28:18.556987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:28:18.556987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 could not be found. Sep 20 22:28:18.556987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:18.558044 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-fc9e99a2-3315-4fdc-ab59-323c50ec61b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Returning 404 to user: Instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:28:18.558044 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-fc9e99a2-3315-4fdc-ab59-323c50ec61b5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 404 len: 111 microversion: 2.1 time: 0.047861 Sep 20 22:28:18.558044 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 269/558] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:18 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:28:18.564086 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-24ca8d42-b328-42ca-8a8e-67a5a0476a93 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '.version_select at 0x7f24f679f3a0>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:18.592675 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-24ca8d42-b328-42ca-8a8e-67a5a0476a93 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114063506" status: 202 len: 0 microversion: 2.1 time: 0.032353 Sep 20 22:28:18.593711 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 290/559] 10.222.0.16 () {58 vars in 1221 bytes} [Tue Sep 20 22:28:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114063506 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:28:18.976194 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-1f72d950-bbab-43f1-97c6-7e619c4407c5 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Action: 'create', calling method: .version_select at 0x7f24f75484c0>, body: {"keypair": {"name": "tempest-keypair-132269335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZwdkco7V7WAEawozSaXcMlYNLWQxSONwhcMEMyDcqWLPMN+9poi0z0hC81haR0i+qbHGHAgFRHcCrba8Q9gdsW2FVXD6LvesvXI+xXkSeJ5cs52gkdTqiQXHC1NGibXQ=="}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:18.995017 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-1f72d950-bbab-43f1-97c6-7e619c4407c5 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Getting quotas for project 897090e72bcc4d978384c95688ab8021. Resources: {'key_pairs'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:28:18.999103 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-1f72d950-bbab-43f1-97c6-7e619c4407c5 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Getting quotas for user 69928e19721a455fb614c6f755495449 and project 897090e72bcc4d978384c95688ab8021. Resources: {'key_pairs'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:28:19.027991 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-78790b2f-038d-4085-8a19-b46befb44b22 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:19.028841 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-78790b2f-038d-4085-8a19-b46befb44b22 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:19.035522 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-1f72d950-bbab-43f1-97c6-7e619c4407c5 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.063436 Sep 20 22:28:19.036458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 270/560] 10.222.0.16 () {62 vars in 1200 bytes} [Tue Sep 20 22:28:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 20 22:28:19.041681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-78790b2f-038d-4085-8a19-b46befb44b22 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:19.042267 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-78790b2f-038d-4085-8a19-b46befb44b22 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:19.042717 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-78790b2f-038d-4085-8a19-b46befb44b22 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:19.043446 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-78790b2f-038d-4085-8a19-b46befb44b22 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:19.043898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-78790b2f-038d-4085-8a19-b46befb44b22 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:19.044380 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-78790b2f-038d-4085-8a19-b46befb44b22 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:19.181190 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-5bfca49a-3187-4a4c-9f5e-8fb08be68791 req-1bae199c-4727-4066-baac-4b849eca735b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc14577-a081-4fbe-9687-94753644450a", "tag": "35caed36-f226-4dcb-909b-d6cf62599c3e"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:19.192686 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-5bfca49a-3187-4a4c-9f5e-8fb08be68791 req-1bae199c-4727-4066-baac-4b849eca735b service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:19.198179 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-5bfca49a-3187-4a4c-9f5e-8fb08be68791 req-1bae199c-4727-4066-baac-4b849eca735b service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:19.198861 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-5bfca49a-3187-4a4c-9f5e-8fb08be68791 req-1bae199c-4727-4066-baac-4b849eca735b service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:19.226141 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-5bfca49a-3187-4a4c-9f5e-8fb08be68791 req-1bae199c-4727-4066-baac-4b849eca735b service nova] Creating event network-changed:35caed36-f226-4dcb-909b-d6cf62599c3e for instance 1bc14577-a081-4fbe-9687-94753644450a on hv-cinder-85827 Sep 20 22:28:19.233414 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-5bfca49a-3187-4a4c-9f5e-8fb08be68791 req-1bae199c-4727-4066-baac-4b849eca735b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055394 Sep 20 22:28:19.235082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 271/561] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:28:19.290785 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-78790b2f-038d-4085-8a19-b46befb44b22 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:19.301493 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-78790b2f-038d-4085-8a19-b46befb44b22 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 200 len: 1318 microversion: 2.1 time: 0.278638 Sep 20 22:28:19.302282 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 291/562] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:19 2022] GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:19.705610 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d5a7f847-88c0-4036-8963-69948f186419 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Action: 'create', calling method: .version_select at 0x7f24f68b9040>, body: {"keypair": {"name": "tempest-keypair-744753904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3LEqHn2HMOssb/4dBfoCqyjZDN/FBSNY/BGDF4IetGONEFNXmqSgBHC2Hc5zaqaZh8+mxiKMsQ0GTeUQ1or9HhV4pJ4R+yzWVKddVCsun/9gW2t2IPm8BYIth/9ohEew=="}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:19.721609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-d5a7f847-88c0-4036-8963-69948f186419 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Getting quotas for project 02ff885440634a13916a25973bdde7b3. Resources: {'key_pairs'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:28:19.726143 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-d5a7f847-88c0-4036-8963-69948f186419 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Getting quotas for user c45fbc2758e641fba97c0b3096db4f15 and project 02ff885440634a13916a25973bdde7b3. Resources: {'key_pairs'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:28:19.750487 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-d5a7f847-88c0-4036-8963-69948f186419 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049084 Sep 20 22:28:19.751240 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 272/563] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 20 22:28:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:28:20.333042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-fa569c2b-7869-4882-ae84-c7864ec38c62 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:20.333770 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-fa569c2b-7869-4882-ae84-c7864ec38c62 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:20.342913 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fa569c2b-7869-4882-ae84-c7864ec38c62 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:20.343629 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fa569c2b-7869-4882-ae84-c7864ec38c62 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:20.344224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fa569c2b-7869-4882-ae84-c7864ec38c62 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:20.345108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fa569c2b-7869-4882-ae84-c7864ec38c62 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:20.346356 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fa569c2b-7869-4882-ae84-c7864ec38c62 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:20.347164 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fa569c2b-7869-4882-ae84-c7864ec38c62 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:20.579716 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-fa569c2b-7869-4882-ae84-c7864ec38c62 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:20.594045 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-fa569c2b-7869-4882-ae84-c7864ec38c62 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 200 len: 1318 microversion: 2.1 time: 0.268554 Sep 20 22:28:20.594651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 292/564] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:20 2022] GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:20.833072 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d987227f-4654-4fc5-bd9c-130602375804 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1320278308", "imageRef": "a1be001e-c2e4-44b7-b0d2-af96de3855c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "281a7f2f-13d6-4f53-b28b-ee8d71863530"}], "security_groups": [{"name": "tempest-securitygroup--1272143515"}], "key_name": "tempest-keypair-132269335", "user_data": "}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:21.215972 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.network.neutron [None req-d987227f-4654-4fc5-bd9c-130602375804 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] validate_networks() for [('281a7f2f-13d6-4f53-b28b-ee8d71863530', None, None, None, None, None)] {{(pid=120473) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:28:21.617990 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-d533c422-1bb9-4ac8-875f-cf4197e5e9fb tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:21.618600 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-d533c422-1bb9-4ac8-875f-cf4197e5e9fb tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:21.621029 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:21.626572 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d533c422-1bb9-4ac8-875f-cf4197e5e9fb tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:21.627056 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d533c422-1bb9-4ac8-875f-cf4197e5e9fb tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:21.627517 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d533c422-1bb9-4ac8-875f-cf4197e5e9fb tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:21.628228 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d533c422-1bb9-4ac8-875f-cf4197e5e9fb tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:21.628691 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d533c422-1bb9-4ac8-875f-cf4197e5e9fb tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:21.629145 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d533c422-1bb9-4ac8-875f-cf4197e5e9fb tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:21.635233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:21.764339 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-d533c422-1bb9-4ac8-875f-cf4197e5e9fb tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:21.772094 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-d533c422-1bb9-4ac8-875f-cf4197e5e9fb tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 200 len: 1318 microversion: 2.1 time: 0.158804 Sep 20 22:28:21.772664 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 293/565] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:21 2022] GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:21.921655 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-d987227f-4654-4fc5-bd9c-130602375804 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Flavor limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:28:21.922163 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-d987227f-4654-4fc5-bd9c-130602375804 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Image limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:28:21.922543 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-d987227f-4654-4fc5-bd9c-130602375804 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Flavor pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:28:21.922927 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-d987227f-4654-4fc5-bd9c-130602375804 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Image pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:28:21.923329 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-d987227f-4654-4fc5-bd9c-130602375804 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:28:21.931816 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d987227f-4654-4fc5-bd9c-130602375804 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:21.932291 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d987227f-4654-4fc5-bd9c-130602375804 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:21.932725 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d987227f-4654-4fc5-bd9c-130602375804 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:21.933493 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d987227f-4654-4fc5-bd9c-130602375804 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:21.933942 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d987227f-4654-4fc5-bd9c-130602375804 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:21.934355 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d987227f-4654-4fc5-bd9c-130602375804 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:21.951771 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-d987227f-4654-4fc5-bd9c-130602375804 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Getting quotas for project 897090e72bcc4d978384c95688ab8021. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:28:21.955673 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-d987227f-4654-4fc5-bd9c-130602375804 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Getting quotas for user 69928e19721a455fb614c6f755495449 and project 897090e72bcc4d978384c95688ab8021. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:28:21.966925 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d987227f-4654-4fc5-bd9c-130602375804 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Going to run 1 instances... {{(pid=120473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:28:21.969333 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d987227f-4654-4fc5-bd9c-130602375804 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a1be001e-c2e4-44b7-b0d2-af96de3855c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:28:22.015940 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-d987227f-4654-4fc5-bd9c-130602375804 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.187850 Sep 20 22:28:22.023268 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 273/566] 10.222.0.16 () {62 vars in 1188 bytes} [Tue Sep 20 22:28:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 20 22:28:22.028694 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4b5598bb-b4e1-400d-a971-38539e6fd9c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:22.029372 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4b5598bb-b4e1-400d-a971-38539e6fd9c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:22.085756 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4b5598bb-b4e1-400d-a971-38539e6fd9c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:22.095233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4b5598bb-b4e1-400d-a971-38539e6fd9c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:22.098027 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4b5598bb-b4e1-400d-a971-38539e6fd9c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:22.099554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4b5598bb-b4e1-400d-a971-38539e6fd9c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1281 microversion: 2.20 time: 0.074731 Sep 20 22:28:22.100677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 294/567] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:22 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:28:22.140396 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b1b1f594-b411-4d38-bd60-affdbd3b2906 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1679430576", "imageRef": "a1be001e-c2e4-44b7-b0d2-af96de3855c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b3cbf78-a136-43a3-9b63-4931c8818134"}], "security_groups": [{"name": "tempest-securitygroup--624351137"}], "key_name": "tempest-keypair-744753904", "user_data": "}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:22.244686 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.network.neutron [None req-b1b1f594-b411-4d38-bd60-affdbd3b2906 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] validate_networks() for [('2b3cbf78-a136-43a3-9b63-4931c8818134', None, None, None, None, None)] {{(pid=120473) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:28:22.642032 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-b1b1f594-b411-4d38-bd60-affdbd3b2906 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Flavor limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:28:22.642455 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-b1b1f594-b411-4d38-bd60-affdbd3b2906 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Image limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:28:22.642928 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-b1b1f594-b411-4d38-bd60-affdbd3b2906 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Flavor pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:28:22.643366 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-b1b1f594-b411-4d38-bd60-affdbd3b2906 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Image pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:28:22.643798 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-b1b1f594-b411-4d38-bd60-affdbd3b2906 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:28:22.652584 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b1b1f594-b411-4d38-bd60-affdbd3b2906 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:22.653105 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b1b1f594-b411-4d38-bd60-affdbd3b2906 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:22.653532 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b1b1f594-b411-4d38-bd60-affdbd3b2906 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:22.654258 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b1b1f594-b411-4d38-bd60-affdbd3b2906 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:22.654709 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b1b1f594-b411-4d38-bd60-affdbd3b2906 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:22.655132 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b1b1f594-b411-4d38-bd60-affdbd3b2906 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:22.665809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:22.675080 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-b1b1f594-b411-4d38-bd60-affdbd3b2906 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Getting quotas for project 02ff885440634a13916a25973bdde7b3. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:28:22.680175 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-b1b1f594-b411-4d38-bd60-affdbd3b2906 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Getting quotas for user c45fbc2758e641fba97c0b3096db4f15 and project 02ff885440634a13916a25973bdde7b3. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:28:22.691916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b1b1f594-b411-4d38-bd60-affdbd3b2906 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Going to run 1 instances... {{(pid=120473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:28:22.694129 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b1b1f594-b411-4d38-bd60-affdbd3b2906 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a1be001e-c2e4-44b7-b0d2-af96de3855c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:28:22.741372 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b1b1f594-b411-4d38-bd60-affdbd3b2906 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.605372 Sep 20 22:28:22.748285 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 274/568] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:28:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 22:28:22.755588 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-7051ea49-fba1-4149-b928-c965e383596f tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:22.756196 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-7051ea49-fba1-4149-b928-c965e383596f tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:22.799504 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-73c92aec-6a4f-470e-8ede-ff69417ed957 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:22.801017 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-73c92aec-6a4f-470e-8ede-ff69417ed957 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:22.808812 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-73c92aec-6a4f-470e-8ede-ff69417ed957 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:22.809362 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-73c92aec-6a4f-470e-8ede-ff69417ed957 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:22.809805 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-73c92aec-6a4f-470e-8ede-ff69417ed957 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:22.810526 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-73c92aec-6a4f-470e-8ede-ff69417ed957 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:22.811005 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-73c92aec-6a4f-470e-8ede-ff69417ed957 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:22.811541 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-73c92aec-6a4f-470e-8ede-ff69417ed957 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:22.812385 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-7051ea49-fba1-4149-b928-c965e383596f tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:22.821894 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-7051ea49-fba1-4149-b928-c965e383596f tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1237 microversion: 2.1 time: 0.072014 Sep 20 22:28:22.822702 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 295/569] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:22 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:22.949672 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-73c92aec-6a4f-470e-8ede-ff69417ed957 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:22.957224 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-73c92aec-6a4f-470e-8ede-ff69417ed957 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 200 len: 1318 microversion: 2.1 time: 0.166881 Sep 20 22:28:22.957784 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 275/570] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:22 2022] GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:23.126028 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-956e0e7d-e1e8-4c29-8ec0-05292d03dadd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:23.127387 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-956e0e7d-e1e8-4c29-8ec0-05292d03dadd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:23.135588 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-956e0e7d-e1e8-4c29-8ec0-05292d03dadd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:23.136171 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-956e0e7d-e1e8-4c29-8ec0-05292d03dadd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:23.136638 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-956e0e7d-e1e8-4c29-8ec0-05292d03dadd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:23.137793 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-956e0e7d-e1e8-4c29-8ec0-05292d03dadd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:23.138351 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-956e0e7d-e1e8-4c29-8ec0-05292d03dadd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:23.138779 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-956e0e7d-e1e8-4c29-8ec0-05292d03dadd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:23.215082 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-956e0e7d-e1e8-4c29-8ec0-05292d03dadd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:23.234905 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-956e0e7d-e1e8-4c29-8ec0-05292d03dadd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:23.236355 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-956e0e7d-e1e8-4c29-8ec0-05292d03dadd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:23.237495 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-956e0e7d-e1e8-4c29-8ec0-05292d03dadd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1333 microversion: 2.20 time: 0.116375 Sep 20 22:28:23.244389 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 296/571] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:23 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1333 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:28:23.844038 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a3e1fcd8-fb47-44ed-9e46-45dcf34956a8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:23.844767 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a3e1fcd8-fb47-44ed-9e46-45dcf34956a8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:23.851178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a3e1fcd8-fb47-44ed-9e46-45dcf34956a8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:23.851661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a3e1fcd8-fb47-44ed-9e46-45dcf34956a8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:23.852096 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a3e1fcd8-fb47-44ed-9e46-45dcf34956a8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:23.852796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a3e1fcd8-fb47-44ed-9e46-45dcf34956a8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:23.853285 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a3e1fcd8-fb47-44ed-9e46-45dcf34956a8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:23.853711 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a3e1fcd8-fb47-44ed-9e46-45dcf34956a8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:23.923474 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a3e1fcd8-fb47-44ed-9e46-45dcf34956a8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:23.931195 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a3e1fcd8-fb47-44ed-9e46-45dcf34956a8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1289 microversion: 2.1 time: 0.091192 Sep 20 22:28:23.931758 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 276/572] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:23 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:23.979787 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-8f693a07-afea-44d5-82ea-b7775671e24a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:23.980456 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-8f693a07-afea-44d5-82ea-b7775671e24a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:23.987122 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8f693a07-afea-44d5-82ea-b7775671e24a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:23.987617 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8f693a07-afea-44d5-82ea-b7775671e24a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:23.988094 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8f693a07-afea-44d5-82ea-b7775671e24a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:23.988981 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8f693a07-afea-44d5-82ea-b7775671e24a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:23.989456 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8f693a07-afea-44d5-82ea-b7775671e24a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:23.989883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8f693a07-afea-44d5-82ea-b7775671e24a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:24.153399 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-8f693a07-afea-44d5-82ea-b7775671e24a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:24.162118 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-8f693a07-afea-44d5-82ea-b7775671e24a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 200 len: 1318 microversion: 2.1 time: 0.186231 Sep 20 22:28:24.176033 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 297/573] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:23 2022] GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:24.271425 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a104e6c7-8157-4e96-8c0c-b66112f84a0f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:24.272136 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a104e6c7-8157-4e96-8c0c-b66112f84a0f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:24.278779 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a104e6c7-8157-4e96-8c0c-b66112f84a0f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:24.280392 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a104e6c7-8157-4e96-8c0c-b66112f84a0f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:24.281454 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a104e6c7-8157-4e96-8c0c-b66112f84a0f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:24.282199 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a104e6c7-8157-4e96-8c0c-b66112f84a0f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:24.282669 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a104e6c7-8157-4e96-8c0c-b66112f84a0f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:24.283096 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a104e6c7-8157-4e96-8c0c-b66112f84a0f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:24.634186 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a104e6c7-8157-4e96-8c0c-b66112f84a0f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:24.642512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a104e6c7-8157-4e96-8c0c-b66112f84a0f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:24.644088 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a104e6c7-8157-4e96-8c0c-b66112f84a0f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:24.645840 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a104e6c7-8157-4e96-8c0c-b66112f84a0f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1407 microversion: 2.20 time: 0.384831 Sep 20 22:28:24.646445 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 277/574] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:24 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1407 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:28:24.955607 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-cdf43800-2b0f-4424-90aa-2868e6f5a96d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:24.956280 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-cdf43800-2b0f-4424-90aa-2868e6f5a96d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:24.962602 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cdf43800-2b0f-4424-90aa-2868e6f5a96d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:24.963093 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cdf43800-2b0f-4424-90aa-2868e6f5a96d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:24.963524 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cdf43800-2b0f-4424-90aa-2868e6f5a96d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:24.964310 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cdf43800-2b0f-4424-90aa-2868e6f5a96d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:24.964835 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cdf43800-2b0f-4424-90aa-2868e6f5a96d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:24.965504 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cdf43800-2b0f-4424-90aa-2868e6f5a96d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:25.031672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-cdf43800-2b0f-4424-90aa-2868e6f5a96d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:25.040915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-cdf43800-2b0f-4424-90aa-2868e6f5a96d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1295 microversion: 2.1 time: 0.089955 Sep 20 22:28:25.042424 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 298/575] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:24 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1295 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:25.163355 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-e6b33e96-298e-4a6f-87fc-1f060860310e req-73ba325f-c933-4cc8-bdab-0743c23f7ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc14577-a081-4fbe-9687-94753644450a", "name": "network-vif-plugged", "status": "completed", "tag": "35caed36-f226-4dcb-909b-d6cf62599c3e"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:25.178925 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-e6b33e96-298e-4a6f-87fc-1f060860310e req-73ba325f-c933-4cc8-bdab-0743c23f7ab5 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:25.179419 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-e6b33e96-298e-4a6f-87fc-1f060860310e req-73ba325f-c933-4cc8-bdab-0743c23f7ab5 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:25.179902 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-e6b33e96-298e-4a6f-87fc-1f060860310e req-73ba325f-c933-4cc8-bdab-0743c23f7ab5 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:25.186110 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c481bed3-aa5d-4e9b-8ded-fbbe6465b673 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:25.187075 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-c481bed3-aa5d-4e9b-8ded-fbbe6465b673 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:25.194653 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c481bed3-aa5d-4e9b-8ded-fbbe6465b673 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:25.194787 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-e6b33e96-298e-4a6f-87fc-1f060860310e req-73ba325f-c933-4cc8-bdab-0743c23f7ab5 service nova] Creating event network-vif-plugged:35caed36-f226-4dcb-909b-d6cf62599c3e for instance 1bc14577-a081-4fbe-9687-94753644450a on hv-cinder-85827 Sep 20 22:28:25.195658 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c481bed3-aa5d-4e9b-8ded-fbbe6465b673 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:25.196330 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c481bed3-aa5d-4e9b-8ded-fbbe6465b673 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:25.197273 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c481bed3-aa5d-4e9b-8ded-fbbe6465b673 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:25.197933 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c481bed3-aa5d-4e9b-8ded-fbbe6465b673 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:25.199643 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c481bed3-aa5d-4e9b-8ded-fbbe6465b673 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:25.200446 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-e6b33e96-298e-4a6f-87fc-1f060860310e req-73ba325f-c933-4cc8-bdab-0743c23f7ab5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041429 Sep 20 22:28:25.201522 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 278/576] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:28:25.368724 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-c481bed3-aa5d-4e9b-8ded-fbbe6465b673 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:25.386072 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c481bed3-aa5d-4e9b-8ded-fbbe6465b673 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 200 len: 1318 microversion: 2.1 time: 0.204070 Sep 20 22:28:25.390287 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 299/577] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:25 2022] GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:25.671480 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b8118740-c053-4b6b-9d4b-5f96e8082514 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:25.672158 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b8118740-c053-4b6b-9d4b-5f96e8082514 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:25.678518 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b8118740-c053-4b6b-9d4b-5f96e8082514 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:25.679030 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b8118740-c053-4b6b-9d4b-5f96e8082514 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:25.679459 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b8118740-c053-4b6b-9d4b-5f96e8082514 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:25.680187 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b8118740-c053-4b6b-9d4b-5f96e8082514 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:25.680635 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b8118740-c053-4b6b-9d4b-5f96e8082514 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:25.681084 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b8118740-c053-4b6b-9d4b-5f96e8082514 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:25.723753 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-7575a53c-6dc0-496a-a2a2-856c681d2f5a req-ca08cf7c-985a-46d9-94e6-3704b907ffa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "822d0d2c-d682-4143-b1b3-7feeaf3636f7", "tag": "d76e99ad-dedc-45dd-ba58-8632f5cb0aba"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:25.736166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-7575a53c-6dc0-496a-a2a2-856c681d2f5a req-ca08cf7c-985a-46d9-94e6-3704b907ffa3 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:25.737069 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-7575a53c-6dc0-496a-a2a2-856c681d2f5a req-ca08cf7c-985a-46d9-94e6-3704b907ffa3 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:25.737739 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-7575a53c-6dc0-496a-a2a2-856c681d2f5a req-ca08cf7c-985a-46d9-94e6-3704b907ffa3 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:25.752762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-7575a53c-6dc0-496a-a2a2-856c681d2f5a req-ca08cf7c-985a-46d9-94e6-3704b907ffa3 service nova] Creating event network-changed:d76e99ad-dedc-45dd-ba58-8632f5cb0aba for instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 on hv-cinder-85827 Sep 20 22:28:25.759829 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-7575a53c-6dc0-496a-a2a2-856c681d2f5a req-ca08cf7c-985a-46d9-94e6-3704b907ffa3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041132 Sep 20 22:28:25.760676 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 300/578] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:28:25.937809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b8118740-c053-4b6b-9d4b-5f96e8082514 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:25.946351 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b8118740-c053-4b6b-9d4b-5f96e8082514 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:25.947790 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b8118740-c053-4b6b-9d4b-5f96e8082514 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:25.948886 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b8118740-c053-4b6b-9d4b-5f96e8082514 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1407 microversion: 2.20 time: 0.281863 Sep 20 22:28:25.949479 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 279/579] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:25 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:28:26.066453 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f5c31350-7f7c-483a-9bd0-411c81b38422 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:26.067068 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-f5c31350-7f7c-483a-9bd0-411c81b38422 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:26.073353 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f5c31350-7f7c-483a-9bd0-411c81b38422 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:26.073834 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f5c31350-7f7c-483a-9bd0-411c81b38422 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:26.074263 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f5c31350-7f7c-483a-9bd0-411c81b38422 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:26.074948 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f5c31350-7f7c-483a-9bd0-411c81b38422 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:26.075392 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f5c31350-7f7c-483a-9bd0-411c81b38422 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:26.075809 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f5c31350-7f7c-483a-9bd0-411c81b38422 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:26.203090 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-f5c31350-7f7c-483a-9bd0-411c81b38422 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:26.211192 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-f5c31350-7f7c-483a-9bd0-411c81b38422 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1362 microversion: 2.1 time: 0.149956 Sep 20 22:28:26.211756 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 301/580] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:26 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:26.408763 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-61ee1a87-11c0-4bc3-a8ab-6c08e01edd37 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:26.409401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-61ee1a87-11c0-4bc3-a8ab-6c08e01edd37 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:26.416746 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-61ee1a87-11c0-4bc3-a8ab-6c08e01edd37 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:26.417269 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-61ee1a87-11c0-4bc3-a8ab-6c08e01edd37 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:26.417706 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-61ee1a87-11c0-4bc3-a8ab-6c08e01edd37 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:26.418407 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-61ee1a87-11c0-4bc3-a8ab-6c08e01edd37 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:26.418889 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-61ee1a87-11c0-4bc3-a8ab-6c08e01edd37 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:26.419307 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-61ee1a87-11c0-4bc3-a8ab-6c08e01edd37 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:26.756172 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-61ee1a87-11c0-4bc3-a8ab-6c08e01edd37 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:26.766865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-61ee1a87-11c0-4bc3-a8ab-6c08e01edd37 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 200 len: 1318 microversion: 2.1 time: 0.361794 Sep 20 22:28:26.769907 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 280/581] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:26 2022] GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:26.974515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c20dbe78-eb86-4ce4-9768-e1e35b1bce77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:26.975337 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-c20dbe78-eb86-4ce4-9768-e1e35b1bce77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:26.981801 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c20dbe78-eb86-4ce4-9768-e1e35b1bce77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:26.982100 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c20dbe78-eb86-4ce4-9768-e1e35b1bce77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:26.982601 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c20dbe78-eb86-4ce4-9768-e1e35b1bce77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:26.983366 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c20dbe78-eb86-4ce4-9768-e1e35b1bce77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:26.984158 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c20dbe78-eb86-4ce4-9768-e1e35b1bce77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:26.984438 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c20dbe78-eb86-4ce4-9768-e1e35b1bce77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:27.119693 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-c20dbe78-eb86-4ce4-9768-e1e35b1bce77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:27.128256 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-c20dbe78-eb86-4ce4-9768-e1e35b1bce77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:27.129736 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-c20dbe78-eb86-4ce4-9768-e1e35b1bce77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:27.130836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c20dbe78-eb86-4ce4-9768-e1e35b1bce77 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1407 microversion: 2.20 time: 0.161148 Sep 20 22:28:27.131386 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 302/582] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:26 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:28:27.233730 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-82654509-51e8-450a-9aa5-08b7d8176f81 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:27.234766 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-82654509-51e8-450a-9aa5-08b7d8176f81 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:27.240900 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-82654509-51e8-450a-9aa5-08b7d8176f81 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:27.241476 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-82654509-51e8-450a-9aa5-08b7d8176f81 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:27.242323 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-82654509-51e8-450a-9aa5-08b7d8176f81 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:27.242981 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-82654509-51e8-450a-9aa5-08b7d8176f81 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:27.243459 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-82654509-51e8-450a-9aa5-08b7d8176f81 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:27.243879 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-82654509-51e8-450a-9aa5-08b7d8176f81 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:27.381097 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-82654509-51e8-450a-9aa5-08b7d8176f81 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:27.388867 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-82654509-51e8-450a-9aa5-08b7d8176f81 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1362 microversion: 2.1 time: 0.159186 Sep 20 22:28:27.389512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 281/583] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:27 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:27.791617 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-7151a601-6d66-4af7-91eb-230103df6828 req-143bef69-6164-4a70-be10-628ae6e674f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383da7f3-a48b-45bf-aa96-d3eb43320ed0", "tag": "0cfdba0d-6995-4cd9-a5d7-8cea3b491626"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:27.792230 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-d9fe6337-3231-4370-91c2-5f96b5eeccaa tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:27.792349 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-d9fe6337-3231-4370-91c2-5f96b5eeccaa tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:27.798260 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d9fe6337-3231-4370-91c2-5f96b5eeccaa tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:27.798761 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d9fe6337-3231-4370-91c2-5f96b5eeccaa tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:27.799190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d9fe6337-3231-4370-91c2-5f96b5eeccaa tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:27.799872 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d9fe6337-3231-4370-91c2-5f96b5eeccaa tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:27.800825 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d9fe6337-3231-4370-91c2-5f96b5eeccaa tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:27.801269 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d9fe6337-3231-4370-91c2-5f96b5eeccaa tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:27.801791 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-7151a601-6d66-4af7-91eb-230103df6828 req-143bef69-6164-4a70-be10-628ae6e674f2 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:27.802265 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-7151a601-6d66-4af7-91eb-230103df6828 req-143bef69-6164-4a70-be10-628ae6e674f2 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:27.802690 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-7151a601-6d66-4af7-91eb-230103df6828 req-143bef69-6164-4a70-be10-628ae6e674f2 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:27.813384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-7151a601-6d66-4af7-91eb-230103df6828 req-143bef69-6164-4a70-be10-628ae6e674f2 service nova] Creating event network-changed:0cfdba0d-6995-4cd9-a5d7-8cea3b491626 for instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 on hv-cinder-85827 Sep 20 22:28:27.818510 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-7151a601-6d66-4af7-91eb-230103df6828 req-143bef69-6164-4a70-be10-628ae6e674f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030514 Sep 20 22:28:27.819121 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 282/584] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:28:27.933486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-d9fe6337-3231-4370-91c2-5f96b5eeccaa tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:27.941634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-d9fe6337-3231-4370-91c2-5f96b5eeccaa tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 200 len: 1507 microversion: 2.1 time: 0.153152 Sep 20 22:28:27.942201 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 303/585] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:27 2022] GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:27.964094 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8e91f216-3418-4dbe-98d1-5e52dc97d5f6 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8eb3b04-e855-4a69-ac0d-4b6cedf0e8ed", "device": "/dev/sdb"}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:27.966988 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8e91f216-3418-4dbe-98d1-5e52dc97d5f6 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:27.973060 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8e91f216-3418-4dbe-98d1-5e52dc97d5f6 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:27.973547 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8e91f216-3418-4dbe-98d1-5e52dc97d5f6 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:27.973982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8e91f216-3418-4dbe-98d1-5e52dc97d5f6 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:27.974670 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8e91f216-3418-4dbe-98d1-5e52dc97d5f6 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:27.975127 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8e91f216-3418-4dbe-98d1-5e52dc97d5f6 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:27.975550 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8e91f216-3418-4dbe-98d1-5e52dc97d5f6 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:28.158275 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-cb735924-075e-4b47-9bdd-04f1133eb028 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:28.158881 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-cb735924-075e-4b47-9bdd-04f1133eb028 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:28.165977 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cb735924-075e-4b47-9bdd-04f1133eb028 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:28.166491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cb735924-075e-4b47-9bdd-04f1133eb028 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:28.166917 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cb735924-075e-4b47-9bdd-04f1133eb028 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:28.167820 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cb735924-075e-4b47-9bdd-04f1133eb028 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:28.168430 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cb735924-075e-4b47-9bdd-04f1133eb028 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:28.168994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cb735924-075e-4b47-9bdd-04f1133eb028 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:28.226653 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-8e91f216-3418-4dbe-98d1-5e52dc97d5f6 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "POST /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266564 Sep 20 22:28:28.227396 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 283/586] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 20 22:28:27 2022] POST /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:28:28.413147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ead47853-0530-46b5-b914-bd043e8ec346 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:28.414636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ead47853-0530-46b5-b914-bd043e8ec346 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:28.426717 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ead47853-0530-46b5-b914-bd043e8ec346 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:28.427518 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ead47853-0530-46b5-b914-bd043e8ec346 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:28.428190 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ead47853-0530-46b5-b914-bd043e8ec346 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:28.429133 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ead47853-0530-46b5-b914-bd043e8ec346 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:28.429757 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ead47853-0530-46b5-b914-bd043e8ec346 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:28.431271 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ead47853-0530-46b5-b914-bd043e8ec346 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:28.577856 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-cb735924-075e-4b47-9bdd-04f1133eb028 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:28.587248 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-cb735924-075e-4b47-9bdd-04f1133eb028 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:28.588739 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-cb735924-075e-4b47-9bdd-04f1133eb028 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:28.589877 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-cb735924-075e-4b47-9bdd-04f1133eb028 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1407 microversion: 2.20 time: 0.436461 Sep 20 22:28:28.590441 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 304/587] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:28 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1407 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:28:28.717778 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ead47853-0530-46b5-b914-bd043e8ec346 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:28.727440 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ead47853-0530-46b5-b914-bd043e8ec346 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1362 microversion: 2.1 time: 0.319134 Sep 20 22:28:28.728696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 284/588] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:28 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:29.615617 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-03621992-3dbb-47f6-a86a-5a26d2a4bafd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:29.616173 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-03621992-3dbb-47f6-a86a-5a26d2a4bafd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:29.622758 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-03621992-3dbb-47f6-a86a-5a26d2a4bafd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:29.623259 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-03621992-3dbb-47f6-a86a-5a26d2a4bafd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:29.623693 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-03621992-3dbb-47f6-a86a-5a26d2a4bafd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:29.624370 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-03621992-3dbb-47f6-a86a-5a26d2a4bafd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:29.624817 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-03621992-3dbb-47f6-a86a-5a26d2a4bafd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:29.625268 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-03621992-3dbb-47f6-a86a-5a26d2a4bafd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:29.751501 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-9ec60f94-4f30-4c54-9f76-6fe8090ef5a3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:29.752221 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-9ec60f94-4f30-4c54-9f76-6fe8090ef5a3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:29.755482 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-03621992-3dbb-47f6-a86a-5a26d2a4bafd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:29.758890 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9ec60f94-4f30-4c54-9f76-6fe8090ef5a3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:29.759370 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9ec60f94-4f30-4c54-9f76-6fe8090ef5a3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:29.759801 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9ec60f94-4f30-4c54-9f76-6fe8090ef5a3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:29.760493 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9ec60f94-4f30-4c54-9f76-6fe8090ef5a3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:29.760941 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9ec60f94-4f30-4c54-9f76-6fe8090ef5a3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:29.761387 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9ec60f94-4f30-4c54-9f76-6fe8090ef5a3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:29.763874 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-03621992-3dbb-47f6-a86a-5a26d2a4bafd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:29.765431 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-03621992-3dbb-47f6-a86a-5a26d2a4bafd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:29.766540 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-03621992-3dbb-47f6-a86a-5a26d2a4bafd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1407 microversion: 2.20 time: 0.155405 Sep 20 22:28:29.767100 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 305/589] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:29 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:28:29.775976 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:29.889132 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-9ec60f94-4f30-4c54-9f76-6fe8090ef5a3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:29.896945 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-9ec60f94-4f30-4c54-9f76-6fe8090ef5a3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1362 microversion: 2.1 time: 0.149583 Sep 20 22:28:29.897555 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 285/590] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:29 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:30.791452 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-197dfbd5-34b2-411a-8308-67f7375a8370 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:30.792083 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-197dfbd5-34b2-411a-8308-67f7375a8370 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:30.798688 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-197dfbd5-34b2-411a-8308-67f7375a8370 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:30.799175 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-197dfbd5-34b2-411a-8308-67f7375a8370 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:30.799605 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-197dfbd5-34b2-411a-8308-67f7375a8370 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:30.800921 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-197dfbd5-34b2-411a-8308-67f7375a8370 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:30.801400 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-197dfbd5-34b2-411a-8308-67f7375a8370 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:30.801831 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-197dfbd5-34b2-411a-8308-67f7375a8370 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:30.919556 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-3d2876b3-b547-4ffe-b551-0a46bb5ad718 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:30.920172 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-3d2876b3-b547-4ffe-b551-0a46bb5ad718 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:30.926975 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3d2876b3-b547-4ffe-b551-0a46bb5ad718 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:30.927467 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3d2876b3-b547-4ffe-b551-0a46bb5ad718 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:30.927879 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3d2876b3-b547-4ffe-b551-0a46bb5ad718 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:30.928575 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3d2876b3-b547-4ffe-b551-0a46bb5ad718 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:30.929049 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3d2876b3-b547-4ffe-b551-0a46bb5ad718 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:30.929473 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3d2876b3-b547-4ffe-b551-0a46bb5ad718 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:30.929888 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-197dfbd5-34b2-411a-8308-67f7375a8370 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:30.937907 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-197dfbd5-34b2-411a-8308-67f7375a8370 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:30.939349 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-197dfbd5-34b2-411a-8308-67f7375a8370 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:30.940440 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-197dfbd5-34b2-411a-8308-67f7375a8370 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1407 microversion: 2.20 time: 0.152902 Sep 20 22:28:30.941577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 306/591] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:30 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:28:31.059302 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-3d2876b3-b547-4ffe-b551-0a46bb5ad718 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:31.067794 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-3d2876b3-b547-4ffe-b551-0a46bb5ad718 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1362 microversion: 2.1 time: 0.152031 Sep 20 22:28:31.068380 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 286/592] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:30 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:31.965837 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-70c9a870-6945-4f12-aa64-d3c27d1a01b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:31.966447 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-70c9a870-6945-4f12-aa64-d3c27d1a01b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:31.972803 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-70c9a870-6945-4f12-aa64-d3c27d1a01b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:31.973318 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-70c9a870-6945-4f12-aa64-d3c27d1a01b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:31.973754 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-70c9a870-6945-4f12-aa64-d3c27d1a01b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:31.974442 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-70c9a870-6945-4f12-aa64-d3c27d1a01b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:31.974895 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-70c9a870-6945-4f12-aa64-d3c27d1a01b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:31.975321 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-70c9a870-6945-4f12-aa64-d3c27d1a01b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:32.089686 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a6552713-b9f2-443d-97c2-34d06529a07d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:32.090296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a6552713-b9f2-443d-97c2-34d06529a07d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:32.096785 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a6552713-b9f2-443d-97c2-34d06529a07d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:32.097323 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a6552713-b9f2-443d-97c2-34d06529a07d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:32.097754 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a6552713-b9f2-443d-97c2-34d06529a07d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:32.098443 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a6552713-b9f2-443d-97c2-34d06529a07d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:32.098891 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a6552713-b9f2-443d-97c2-34d06529a07d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:32.099123 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-70c9a870-6945-4f12-aa64-d3c27d1a01b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:32.099339 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a6552713-b9f2-443d-97c2-34d06529a07d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:32.107872 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-70c9a870-6945-4f12-aa64-d3c27d1a01b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:32.109595 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-70c9a870-6945-4f12-aa64-d3c27d1a01b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:32.110712 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-70c9a870-6945-4f12-aa64-d3c27d1a01b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1407 microversion: 2.20 time: 0.148782 Sep 20 22:28:32.111307 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 307/593] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:31 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:28:32.224416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a6552713-b9f2-443d-97c2-34d06529a07d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:32.231943 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a6552713-b9f2-443d-97c2-34d06529a07d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1362 microversion: 2.1 time: 0.146160 Sep 20 22:28:32.232505 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 287/594] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:32 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:33.135981 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-2a72b2bf-74bb-4f15-99c9-37359fb727de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:33.136592 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-2a72b2bf-74bb-4f15-99c9-37359fb727de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:33.138689 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=4 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:33.144830 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2a72b2bf-74bb-4f15-99c9-37359fb727de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:33.145332 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2a72b2bf-74bb-4f15-99c9-37359fb727de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:33.145761 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2a72b2bf-74bb-4f15-99c9-37359fb727de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:33.146444 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2a72b2bf-74bb-4f15-99c9-37359fb727de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:33.146893 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2a72b2bf-74bb-4f15-99c9-37359fb727de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:33.147328 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2a72b2bf-74bb-4f15-99c9-37359fb727de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:33.254714 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-80656017-ab75-4ec9-b176-b43f83ab0b97 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:33.255298 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-80656017-ab75-4ec9-b176-b43f83ab0b97 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:33.257153 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=6 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:33.257958 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=28 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:33.264805 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-80656017-ab75-4ec9-b176-b43f83ab0b97 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:33.265319 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-80656017-ab75-4ec9-b176-b43f83ab0b97 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:33.265960 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-80656017-ab75-4ec9-b176-b43f83ab0b97 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:33.266665 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-80656017-ab75-4ec9-b176-b43f83ab0b97 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:33.267110 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-80656017-ab75-4ec9-b176-b43f83ab0b97 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:33.267719 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-80656017-ab75-4ec9-b176-b43f83ab0b97 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:33.283297 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-2a72b2bf-74bb-4f15-99c9-37359fb727de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:33.293329 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-2a72b2bf-74bb-4f15-99c9-37359fb727de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:33.295097 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-2a72b2bf-74bb-4f15-99c9-37359fb727de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:33.296500 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-2a72b2bf-74bb-4f15-99c9-37359fb727de tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1407 microversion: 2.20 time: 0.164680 Sep 20 22:28:33.297328 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 308/595] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:33 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:28:33.329592 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-f7ba633a-e6ac-4c41-89fb-1afa21dfd824 req-cc41fcfd-e584-498f-8e48-f12c6fc3882f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822d0d2c-d682-4143-b1b3-7feeaf3636f7", "name": "network-vif-plugged", "status": "completed", "tag": "d76e99ad-dedc-45dd-ba58-8632f5cb0aba"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:33.341181 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-f7ba633a-e6ac-4c41-89fb-1afa21dfd824 req-cc41fcfd-e584-498f-8e48-f12c6fc3882f service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:33.341754 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-f7ba633a-e6ac-4c41-89fb-1afa21dfd824 req-cc41fcfd-e584-498f-8e48-f12c6fc3882f service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:33.342261 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-f7ba633a-e6ac-4c41-89fb-1afa21dfd824 req-cc41fcfd-e584-498f-8e48-f12c6fc3882f service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:33.360057 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-f7ba633a-e6ac-4c41-89fb-1afa21dfd824 req-cc41fcfd-e584-498f-8e48-f12c6fc3882f service nova] Creating event network-vif-plugged:d76e99ad-dedc-45dd-ba58-8632f5cb0aba for instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 on hv-cinder-85827 Sep 20 22:28:33.365709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-f7ba633a-e6ac-4c41-89fb-1afa21dfd824 req-cc41fcfd-e584-498f-8e48-f12c6fc3882f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039867 Sep 20 22:28:33.366575 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 309/596] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:28:33.416882 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-80656017-ab75-4ec9-b176-b43f83ab0b97 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:33.424430 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-80656017-ab75-4ec9-b176-b43f83ab0b97 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1362 microversion: 2.1 time: 0.173537 Sep 20 22:28:33.425367 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 288/597] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:33 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:34.051081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-d6331f46-4a3b-4f73-ba65-c7eab7b723be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:34.051623 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-d6331f46-4a3b-4f73-ba65-c7eab7b723be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:34.057787 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d6331f46-4a3b-4f73-ba65-c7eab7b723be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:34.058272 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d6331f46-4a3b-4f73-ba65-c7eab7b723be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:34.058708 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d6331f46-4a3b-4f73-ba65-c7eab7b723be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:34.059396 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d6331f46-4a3b-4f73-ba65-c7eab7b723be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:34.059850 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d6331f46-4a3b-4f73-ba65-c7eab7b723be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:34.060274 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d6331f46-4a3b-4f73-ba65-c7eab7b723be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:34.082494 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-d6331f46-4a3b-4f73-ba65-c7eab7b723be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lazy-loading 'flavor' on Instance uuid a507bbd4-a0a2-4ca8-b04a-1511797060be {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:28:34.152682 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-d6331f46-4a3b-4f73-ba65-c7eab7b723be tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "POST /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be/action" status: 202 len: 0 microversion: 2.1 time: 0.105796 Sep 20 22:28:34.153369 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 310/598] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 20 22:28:34 2022] POST /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:28:34.162268 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-cd72a022-5a45-4fec-ac06-f2a1ae8bcdd2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:34.162878 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-cd72a022-5a45-4fec-ac06-f2a1ae8bcdd2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:34.168640 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cd72a022-5a45-4fec-ac06-f2a1ae8bcdd2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:34.169157 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cd72a022-5a45-4fec-ac06-f2a1ae8bcdd2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:34.169591 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cd72a022-5a45-4fec-ac06-f2a1ae8bcdd2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:34.170263 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cd72a022-5a45-4fec-ac06-f2a1ae8bcdd2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:34.170710 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cd72a022-5a45-4fec-ac06-f2a1ae8bcdd2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:34.171133 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cd72a022-5a45-4fec-ac06-f2a1ae8bcdd2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:34.300552 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-cd72a022-5a45-4fec-ac06-f2a1ae8bcdd2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:34.308841 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-cd72a022-5a45-4fec-ac06-f2a1ae8bcdd2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.150931 Sep 20 22:28:34.309385 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 289/599] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:34 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:34.325214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-2dfd2d92-af24-4efa-9367-baad9ac045ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:34.325906 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-2dfd2d92-af24-4efa-9367-baad9ac045ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:34.332493 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2dfd2d92-af24-4efa-9367-baad9ac045ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:34.332991 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2dfd2d92-af24-4efa-9367-baad9ac045ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:34.333431 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2dfd2d92-af24-4efa-9367-baad9ac045ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:34.334103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2dfd2d92-af24-4efa-9367-baad9ac045ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:34.334549 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2dfd2d92-af24-4efa-9367-baad9ac045ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:34.334960 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2dfd2d92-af24-4efa-9367-baad9ac045ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:34.339331 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:34.449508 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b84769ca-a891-4311-a608-7c13983c8a4c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:34.450123 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b84769ca-a891-4311-a608-7c13983c8a4c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:34.455989 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b84769ca-a891-4311-a608-7c13983c8a4c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:34.457052 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b84769ca-a891-4311-a608-7c13983c8a4c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:34.457494 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b84769ca-a891-4311-a608-7c13983c8a4c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:34.458220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b84769ca-a891-4311-a608-7c13983c8a4c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:34.458671 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b84769ca-a891-4311-a608-7c13983c8a4c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:34.459094 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b84769ca-a891-4311-a608-7c13983c8a4c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:34.469721 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-2dfd2d92-af24-4efa-9367-baad9ac045ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:34.477899 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-2dfd2d92-af24-4efa-9367-baad9ac045ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:34.479467 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-2dfd2d92-af24-4efa-9367-baad9ac045ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:34.480581 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-2dfd2d92-af24-4efa-9367-baad9ac045ac tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1407 microversion: 2.20 time: 0.161231 Sep 20 22:28:34.481162 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 311/600] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:34 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:28:34.587644 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b84769ca-a891-4311-a608-7c13983c8a4c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:34.595423 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b84769ca-a891-4311-a608-7c13983c8a4c tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1362 microversion: 2.1 time: 0.149838 Sep 20 22:28:34.595999 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 290/601] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:34 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:35.335120 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-d805e49b-794c-43b0-9813-444cf37c680f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:35.336122 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-d805e49b-794c-43b0-9813-444cf37c680f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:35.342255 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d805e49b-794c-43b0-9813-444cf37c680f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:35.342950 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d805e49b-794c-43b0-9813-444cf37c680f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:35.343377 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d805e49b-794c-43b0-9813-444cf37c680f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:35.344237 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d805e49b-794c-43b0-9813-444cf37c680f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:35.344715 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d805e49b-794c-43b0-9813-444cf37c680f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:35.345338 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d805e49b-794c-43b0-9813-444cf37c680f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:35.390671 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-5244b8a4-0992-4816-9bd1-7269d7492e8f req-58c0c6f2-8298-4159-8fcf-ba63350447ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383da7f3-a48b-45bf-aa96-d3eb43320ed0", "name": "network-vif-plugged", "status": "completed", "tag": "0cfdba0d-6995-4cd9-a5d7-8cea3b491626"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:35.402047 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-5244b8a4-0992-4816-9bd1-7269d7492e8f req-58c0c6f2-8298-4159-8fcf-ba63350447ee service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:35.402451 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-5244b8a4-0992-4816-9bd1-7269d7492e8f req-58c0c6f2-8298-4159-8fcf-ba63350447ee service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:35.402888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-5244b8a4-0992-4816-9bd1-7269d7492e8f req-58c0c6f2-8298-4159-8fcf-ba63350447ee service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:35.414374 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-5244b8a4-0992-4816-9bd1-7269d7492e8f req-58c0c6f2-8298-4159-8fcf-ba63350447ee service nova] Creating event network-vif-plugged:0cfdba0d-6995-4cd9-a5d7-8cea3b491626 for instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 on hv-cinder-85827 Sep 20 22:28:35.419463 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-5244b8a4-0992-4816-9bd1-7269d7492e8f req-58c0c6f2-8298-4159-8fcf-ba63350447ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033166 Sep 20 22:28:35.420060 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 291/602] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:28:35.483717 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-d805e49b-794c-43b0-9813-444cf37c680f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:35.491406 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-d805e49b-794c-43b0-9813-444cf37c680f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.161623 Sep 20 22:28:35.492230 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 312/603] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:35 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:35.506226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-714bd48e-9bea-4cc2-95dc-601f212c89b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:35.506922 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-714bd48e-9bea-4cc2-95dc-601f212c89b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:35.513131 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-714bd48e-9bea-4cc2-95dc-601f212c89b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:35.513609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-714bd48e-9bea-4cc2-95dc-601f212c89b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:35.514039 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-714bd48e-9bea-4cc2-95dc-601f212c89b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:35.514719 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-714bd48e-9bea-4cc2-95dc-601f212c89b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:35.515162 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-714bd48e-9bea-4cc2-95dc-601f212c89b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:35.515578 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-714bd48e-9bea-4cc2-95dc-601f212c89b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:35.617974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c4a572a1-44aa-4b62-a186-b6d64ade0427 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:35.618579 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-c4a572a1-44aa-4b62-a186-b6d64ade0427 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:35.624520 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c4a572a1-44aa-4b62-a186-b6d64ade0427 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:35.625023 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c4a572a1-44aa-4b62-a186-b6d64ade0427 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:35.625459 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c4a572a1-44aa-4b62-a186-b6d64ade0427 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:35.626151 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c4a572a1-44aa-4b62-a186-b6d64ade0427 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:35.626605 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c4a572a1-44aa-4b62-a186-b6d64ade0427 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:35.627028 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c4a572a1-44aa-4b62-a186-b6d64ade0427 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:35.769792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-c4a572a1-44aa-4b62-a186-b6d64ade0427 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:35.779245 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c4a572a1-44aa-4b62-a186-b6d64ade0427 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1362 microversion: 2.1 time: 0.165250 Sep 20 22:28:35.780206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 313/604] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:35 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:35.784003 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-714bd48e-9bea-4cc2-95dc-601f212c89b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:35.807318 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-714bd48e-9bea-4cc2-95dc-601f212c89b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:35.813074 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-714bd48e-9bea-4cc2-95dc-601f212c89b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:35.814517 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-714bd48e-9bea-4cc2-95dc-601f212c89b6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1598 microversion: 2.20 time: 0.312674 Sep 20 22:28:35.815165 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 292/605] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:28:35 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1598 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:28:35.842201 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-63a847f5-7d12-4118-ab75-6e4f7e44ac69 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:35.842709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-63a847f5-7d12-4118-ab75-6e4f7e44ac69 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:35.849342 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-63a847f5-7d12-4118-ab75-6e4f7e44ac69 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:35.849829 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-63a847f5-7d12-4118-ab75-6e4f7e44ac69 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:35.850266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-63a847f5-7d12-4118-ab75-6e4f7e44ac69 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:35.851013 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-63a847f5-7d12-4118-ab75-6e4f7e44ac69 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:35.851672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-63a847f5-7d12-4118-ab75-6e4f7e44ac69 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:35.852104 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-63a847f5-7d12-4118-ab75-6e4f7e44ac69 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:36.011441 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-63a847f5-7d12-4118-ab75-6e4f7e44ac69 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.173461 Sep 20 22:28:36.012071 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 314/606] 10.222.0.16 () {60 vars in 1316 bytes} [Tue Sep 20 22:28:35 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:28:36.514687 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-67aa0c43-26e0-458e-b958-dff917fbca50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:36.515301 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-67aa0c43-26e0-458e-b958-dff917fbca50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:36.522508 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-67aa0c43-26e0-458e-b958-dff917fbca50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:36.522929 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-67aa0c43-26e0-458e-b958-dff917fbca50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:36.523364 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-67aa0c43-26e0-458e-b958-dff917fbca50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:36.524066 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-67aa0c43-26e0-458e-b958-dff917fbca50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:36.524529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-67aa0c43-26e0-458e-b958-dff917fbca50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:36.524953 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-67aa0c43-26e0-458e-b958-dff917fbca50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:36.760514 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-67aa0c43-26e0-458e-b958-dff917fbca50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:36.768305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-67aa0c43-26e0-458e-b958-dff917fbca50 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.257536 Sep 20 22:28:36.769547 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 293/607] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:36 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:36.803744 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-8c1cd608-8690-4e1d-bda5-8c94833a84fc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:36.804338 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-8c1cd608-8690-4e1d-bda5-8c94833a84fc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:36.810784 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8c1cd608-8690-4e1d-bda5-8c94833a84fc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:36.811665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8c1cd608-8690-4e1d-bda5-8c94833a84fc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:36.812109 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8c1cd608-8690-4e1d-bda5-8c94833a84fc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:36.812856 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8c1cd608-8690-4e1d-bda5-8c94833a84fc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:36.813350 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8c1cd608-8690-4e1d-bda5-8c94833a84fc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:36.813782 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8c1cd608-8690-4e1d-bda5-8c94833a84fc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:36.952408 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-8c1cd608-8690-4e1d-bda5-8c94833a84fc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:36.960632 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-8c1cd608-8690-4e1d-bda5-8c94833a84fc tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1362 microversion: 2.1 time: 0.161945 Sep 20 22:28:36.961261 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 315/608] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:36 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:37.317164 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-b12ad30f-3b05-45cd-bcc5-2889dd74a192 req-c611eb60-640b-480b-8401-537ad9e59c8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "822d0d2c-d682-4143-b1b3-7feeaf3636f7", "tag": "d76e99ad-dedc-45dd-ba58-8632f5cb0aba"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:37.326581 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-b12ad30f-3b05-45cd-bcc5-2889dd74a192 req-c611eb60-640b-480b-8401-537ad9e59c8e service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:37.327056 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-b12ad30f-3b05-45cd-bcc5-2889dd74a192 req-c611eb60-640b-480b-8401-537ad9e59c8e service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:37.327479 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-b12ad30f-3b05-45cd-bcc5-2889dd74a192 req-c611eb60-640b-480b-8401-537ad9e59c8e service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:37.338234 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-b12ad30f-3b05-45cd-bcc5-2889dd74a192 req-c611eb60-640b-480b-8401-537ad9e59c8e service nova] Creating event network-changed:d76e99ad-dedc-45dd-ba58-8632f5cb0aba for instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 on hv-cinder-85827 Sep 20 22:28:37.343688 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-b12ad30f-3b05-45cd-bcc5-2889dd74a192 req-c611eb60-640b-480b-8401-537ad9e59c8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030127 Sep 20 22:28:37.344343 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 294/609] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:28:37.791585 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-277ec49e-f657-400f-aa70-29f0fd1cc844 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:37.792225 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-277ec49e-f657-400f-aa70-29f0fd1cc844 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:37.798381 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-277ec49e-f657-400f-aa70-29f0fd1cc844 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:37.799480 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-277ec49e-f657-400f-aa70-29f0fd1cc844 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:37.800436 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-277ec49e-f657-400f-aa70-29f0fd1cc844 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:37.801165 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-277ec49e-f657-400f-aa70-29f0fd1cc844 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:37.801619 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-277ec49e-f657-400f-aa70-29f0fd1cc844 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:37.802040 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-277ec49e-f657-400f-aa70-29f0fd1cc844 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:37.935701 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-277ec49e-f657-400f-aa70-29f0fd1cc844 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:37.944079 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-277ec49e-f657-400f-aa70-29f0fd1cc844 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.156332 Sep 20 22:28:37.944660 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 316/610] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:37 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:37.984461 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-26b061ac-d278-4ccb-8f32-556524ac0496 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:37.985754 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-26b061ac-d278-4ccb-8f32-556524ac0496 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:37.992913 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-26b061ac-d278-4ccb-8f32-556524ac0496 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:37.993372 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-26b061ac-d278-4ccb-8f32-556524ac0496 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:37.993814 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-26b061ac-d278-4ccb-8f32-556524ac0496 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:37.994516 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-26b061ac-d278-4ccb-8f32-556524ac0496 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:37.994969 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-26b061ac-d278-4ccb-8f32-556524ac0496 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:37.995390 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-26b061ac-d278-4ccb-8f32-556524ac0496 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:38.128883 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-26b061ac-d278-4ccb-8f32-556524ac0496 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:38.137038 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-26b061ac-d278-4ccb-8f32-556524ac0496 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1362 microversion: 2.1 time: 0.157108 Sep 20 22:28:38.137681 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 295/611] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:37 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:38.967674 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9bb61c11-b696-41e5-a417-673e239beff5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:38.968280 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9bb61c11-b696-41e5-a417-673e239beff5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:38.975220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9bb61c11-b696-41e5-a417-673e239beff5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:38.975727 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9bb61c11-b696-41e5-a417-673e239beff5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:38.976157 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9bb61c11-b696-41e5-a417-673e239beff5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:38.976833 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9bb61c11-b696-41e5-a417-673e239beff5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:38.977305 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9bb61c11-b696-41e5-a417-673e239beff5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:38.977723 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9bb61c11-b696-41e5-a417-673e239beff5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:39.105557 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-9bb61c11-b696-41e5-a417-673e239beff5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:39.113258 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-9bb61c11-b696-41e5-a417-673e239beff5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.149384 Sep 20 22:28:39.113825 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 317/612] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:38 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:39.159963 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ac19d85e-6df9-4a4a-8bcd-470e9b124a29 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:39.160573 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ac19d85e-6df9-4a4a-8bcd-470e9b124a29 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:39.167568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ac19d85e-6df9-4a4a-8bcd-470e9b124a29 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:39.168048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ac19d85e-6df9-4a4a-8bcd-470e9b124a29 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:39.168516 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ac19d85e-6df9-4a4a-8bcd-470e9b124a29 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:39.169236 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ac19d85e-6df9-4a4a-8bcd-470e9b124a29 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:39.169688 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ac19d85e-6df9-4a4a-8bcd-470e9b124a29 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:39.170109 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ac19d85e-6df9-4a4a-8bcd-470e9b124a29 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:39.377290 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ac19d85e-6df9-4a4a-8bcd-470e9b124a29 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:39.384812 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ac19d85e-6df9-4a4a-8bcd-470e9b124a29 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1362 microversion: 2.1 time: 0.228734 Sep 20 22:28:39.385418 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 296/613] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:39 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:40.136452 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-df77d6da-dcb3-42f0-b354-6a7d5c2a2a75 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:40.137110 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-df77d6da-dcb3-42f0-b354-6a7d5c2a2a75 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:40.144936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-df77d6da-dcb3-42f0-b354-6a7d5c2a2a75 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:40.145448 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-df77d6da-dcb3-42f0-b354-6a7d5c2a2a75 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:40.145887 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-df77d6da-dcb3-42f0-b354-6a7d5c2a2a75 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:40.146653 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-df77d6da-dcb3-42f0-b354-6a7d5c2a2a75 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:40.147045 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-df77d6da-dcb3-42f0-b354-6a7d5c2a2a75 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:40.147665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-df77d6da-dcb3-42f0-b354-6a7d5c2a2a75 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:40.306054 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-df77d6da-dcb3-42f0-b354-6a7d5c2a2a75 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:40.314312 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-df77d6da-dcb3-42f0-b354-6a7d5c2a2a75 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.182080 Sep 20 22:28:40.314917 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 318/614] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:40 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:40.363388 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8af50e54-60ce-4d63-893b-55824348162c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:40.363913 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8af50e54-60ce-4d63-893b-55824348162c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:40.370418 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8af50e54-60ce-4d63-893b-55824348162c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:40.370899 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8af50e54-60ce-4d63-893b-55824348162c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:40.371326 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8af50e54-60ce-4d63-893b-55824348162c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:40.372007 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8af50e54-60ce-4d63-893b-55824348162c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:40.372454 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8af50e54-60ce-4d63-893b-55824348162c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:40.372873 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8af50e54-60ce-4d63-893b-55824348162c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:40.407382 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-69a5a184-c85d-454c-9646-d8d4c9ec4fe4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:40.408021 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-69a5a184-c85d-454c-9646-d8d4c9ec4fe4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:40.414622 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-69a5a184-c85d-454c-9646-d8d4c9ec4fe4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:40.415103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-69a5a184-c85d-454c-9646-d8d4c9ec4fe4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:40.415568 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-69a5a184-c85d-454c-9646-d8d4c9ec4fe4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:40.416247 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-69a5a184-c85d-454c-9646-d8d4c9ec4fe4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:40.416703 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-69a5a184-c85d-454c-9646-d8d4c9ec4fe4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:40.417176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-69a5a184-c85d-454c-9646-d8d4c9ec4fe4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:40.453994 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-8af50e54-60ce-4d63-893b-55824348162c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lazy-loading 'services' on Instance uuid 704f353f-861e-47cf-9625-7210f9f1f81e {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:28:40.528237 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-8af50e54-60ce-4d63-893b-55824348162c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "DELETE /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-volume_attachments/6462f175-bf13-4ac7-bdc5-1487a4771d42" status: 202 len: 0 microversion: 2.1 time: 0.169161 Sep 20 22:28:40.528958 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 297/615] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 20 22:28:40 2022] DELETE /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-volume_attachments/6462f175-bf13-4ac7-bdc5-1487a4771d42 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:28:40.539480 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-3d76891c-1c3e-44e4-98dd-b0e2d852e66d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:40.542179 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-3d76891c-1c3e-44e4-98dd-b0e2d852e66d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:40.548197 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3d76891c-1c3e-44e4-98dd-b0e2d852e66d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:40.548679 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3d76891c-1c3e-44e4-98dd-b0e2d852e66d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:40.549212 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3d76891c-1c3e-44e4-98dd-b0e2d852e66d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:40.550438 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3d76891c-1c3e-44e4-98dd-b0e2d852e66d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:40.551177 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3d76891c-1c3e-44e4-98dd-b0e2d852e66d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:40.551603 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3d76891c-1c3e-44e4-98dd-b0e2d852e66d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:40.555212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-69a5a184-c85d-454c-9646-d8d4c9ec4fe4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:40.562750 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-69a5a184-c85d-454c-9646-d8d4c9ec4fe4 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1362 microversion: 2.1 time: 0.159194 Sep 20 22:28:40.563315 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 319/616] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:40 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:40.580800 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-3d76891c-1c3e-44e4-98dd-b0e2d852e66d tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045481 Sep 20 22:28:40.581471 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 298/617] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:28:40 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:28:41.337813 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-47df8e32-e297-46de-926c-96d4763f4ae8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:41.338455 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-47df8e32-e297-46de-926c-96d4763f4ae8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:41.344836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-47df8e32-e297-46de-926c-96d4763f4ae8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:41.345348 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-47df8e32-e297-46de-926c-96d4763f4ae8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:41.345778 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-47df8e32-e297-46de-926c-96d4763f4ae8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:41.346463 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-47df8e32-e297-46de-926c-96d4763f4ae8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:41.347569 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-47df8e32-e297-46de-926c-96d4763f4ae8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:41.347992 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-47df8e32-e297-46de-926c-96d4763f4ae8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:41.473490 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-47df8e32-e297-46de-926c-96d4763f4ae8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:41.481476 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-47df8e32-e297-46de-926c-96d4763f4ae8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.147535 Sep 20 22:28:41.482051 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 320/618] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:41 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:41.586367 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-37929543-97d3-4e5b-861b-0f509cdaa699 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:41.586911 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-37929543-97d3-4e5b-861b-0f509cdaa699 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:41.593516 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-61bc66ef-6891-4c82-a197-171231c5bd99 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:41.593843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-37929543-97d3-4e5b-861b-0f509cdaa699 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:41.594334 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-37929543-97d3-4e5b-861b-0f509cdaa699 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:41.594787 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-37929543-97d3-4e5b-861b-0f509cdaa699 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:41.595477 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-37929543-97d3-4e5b-861b-0f509cdaa699 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:41.595925 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-37929543-97d3-4e5b-861b-0f509cdaa699 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:41.596249 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-61bc66ef-6891-4c82-a197-171231c5bd99 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:41.596432 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-37929543-97d3-4e5b-861b-0f509cdaa699 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:41.602696 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61bc66ef-6891-4c82-a197-171231c5bd99 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:41.603184 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61bc66ef-6891-4c82-a197-171231c5bd99 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:41.603618 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61bc66ef-6891-4c82-a197-171231c5bd99 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:41.604349 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61bc66ef-6891-4c82-a197-171231c5bd99 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:41.604805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61bc66ef-6891-4c82-a197-171231c5bd99 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:41.605263 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61bc66ef-6891-4c82-a197-171231c5bd99 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:41.636947 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-61bc66ef-6891-4c82-a197-171231c5bd99 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047519 Sep 20 22:28:41.637544 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 321/619] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:28:41 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:28:41.731333 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-37929543-97d3-4e5b-861b-0f509cdaa699 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:41.739548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-37929543-97d3-4e5b-861b-0f509cdaa699 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1362 microversion: 2.1 time: 0.157570 Sep 20 22:28:41.740124 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 299/620] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:41 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:42.505768 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-7ba8b684-444f-46ac-b29e-d5d7b787df7d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:42.506344 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-7ba8b684-444f-46ac-b29e-d5d7b787df7d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:42.512439 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7ba8b684-444f-46ac-b29e-d5d7b787df7d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:42.512921 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7ba8b684-444f-46ac-b29e-d5d7b787df7d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:42.513389 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7ba8b684-444f-46ac-b29e-d5d7b787df7d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:42.514076 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7ba8b684-444f-46ac-b29e-d5d7b787df7d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:42.514644 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7ba8b684-444f-46ac-b29e-d5d7b787df7d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:42.514958 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7ba8b684-444f-46ac-b29e-d5d7b787df7d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:42.650208 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-fd12858d-5155-437c-91c0-7769c800ae0f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:42.652504 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-fd12858d-5155-437c-91c0-7769c800ae0f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:42.655500 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-7ba8b684-444f-46ac-b29e-d5d7b787df7d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:42.658942 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fd12858d-5155-437c-91c0-7769c800ae0f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:42.659424 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fd12858d-5155-437c-91c0-7769c800ae0f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:42.659862 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fd12858d-5155-437c-91c0-7769c800ae0f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:42.660556 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fd12858d-5155-437c-91c0-7769c800ae0f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:42.661028 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fd12858d-5155-437c-91c0-7769c800ae0f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:42.661646 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fd12858d-5155-437c-91c0-7769c800ae0f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:42.663372 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-7ba8b684-444f-46ac-b29e-d5d7b787df7d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.162241 Sep 20 22:28:42.663939 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 322/621] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:42 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:42.690313 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-fd12858d-5155-437c-91c0-7769c800ae0f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044109 Sep 20 22:28:42.691378 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 300/622] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:28:42 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:28:42.762615 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-676d9118-e08f-42e9-9467-b49323aa21b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:42.763188 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-676d9118-e08f-42e9-9467-b49323aa21b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:42.769737 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-676d9118-e08f-42e9-9467-b49323aa21b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:42.770222 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-676d9118-e08f-42e9-9467-b49323aa21b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:42.770654 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-676d9118-e08f-42e9-9467-b49323aa21b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:42.771339 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-676d9118-e08f-42e9-9467-b49323aa21b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:42.771810 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-676d9118-e08f-42e9-9467-b49323aa21b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:42.772234 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-676d9118-e08f-42e9-9467-b49323aa21b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:42.897794 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-676d9118-e08f-42e9-9467-b49323aa21b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:42.905410 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-676d9118-e08f-42e9-9467-b49323aa21b8 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1362 microversion: 2.1 time: 0.146606 Sep 20 22:28:42.905988 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 323/623] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:42 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:43.686273 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-948353d3-d87e-4981-8b31-216bb7cf0c39 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:43.686883 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-948353d3-d87e-4981-8b31-216bb7cf0c39 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:43.693246 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-948353d3-d87e-4981-8b31-216bb7cf0c39 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:43.693727 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-948353d3-d87e-4981-8b31-216bb7cf0c39 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:43.694160 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-948353d3-d87e-4981-8b31-216bb7cf0c39 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:43.694883 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-948353d3-d87e-4981-8b31-216bb7cf0c39 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:43.695334 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-948353d3-d87e-4981-8b31-216bb7cf0c39 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:43.695755 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-948353d3-d87e-4981-8b31-216bb7cf0c39 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:43.702905 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4689bc07-2743-456c-822b-f901b3286fab tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:43.705126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4689bc07-2743-456c-822b-f901b3286fab tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:43.711955 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4689bc07-2743-456c-822b-f901b3286fab tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:43.712438 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4689bc07-2743-456c-822b-f901b3286fab tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:43.712873 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4689bc07-2743-456c-822b-f901b3286fab tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:43.713588 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4689bc07-2743-456c-822b-f901b3286fab tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:43.714044 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4689bc07-2743-456c-822b-f901b3286fab tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:43.714465 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4689bc07-2743-456c-822b-f901b3286fab tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:43.744747 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4689bc07-2743-456c-822b-f901b3286fab tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045654 Sep 20 22:28:43.745363 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 324/624] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:28:43 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:28:43.829983 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-948353d3-d87e-4981-8b31-216bb7cf0c39 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:43.838601 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-948353d3-d87e-4981-8b31-216bb7cf0c39 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.156217 Sep 20 22:28:43.839200 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 301/625] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:43 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:43.986486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b03f1ddb-2cd3-4f00-9e36-eb3b5ccefe96 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:43.987097 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b03f1ddb-2cd3-4f00-9e36-eb3b5ccefe96 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:43.993287 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b03f1ddb-2cd3-4f00-9e36-eb3b5ccefe96 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:43.993767 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b03f1ddb-2cd3-4f00-9e36-eb3b5ccefe96 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:43.994201 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b03f1ddb-2cd3-4f00-9e36-eb3b5ccefe96 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:43.994884 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b03f1ddb-2cd3-4f00-9e36-eb3b5ccefe96 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:43.995334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b03f1ddb-2cd3-4f00-9e36-eb3b5ccefe96 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:43.995754 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b03f1ddb-2cd3-4f00-9e36-eb3b5ccefe96 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:44.126196 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b03f1ddb-2cd3-4f00-9e36-eb3b5ccefe96 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:44.134373 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b03f1ddb-2cd3-4f00-9e36-eb3b5ccefe96 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1548 microversion: 2.1 time: 0.204684 Sep 20 22:28:44.134942 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 325/626] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:43 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1548 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:44.157417 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-fce700af-3b0b-4ef5-aacb-eec6254e3ec5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:44.157916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-fce700af-3b0b-4ef5-aacb-eec6254e3ec5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:44.164435 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fce700af-3b0b-4ef5-aacb-eec6254e3ec5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:44.164918 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fce700af-3b0b-4ef5-aacb-eec6254e3ec5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:44.165434 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fce700af-3b0b-4ef5-aacb-eec6254e3ec5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:44.166126 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fce700af-3b0b-4ef5-aacb-eec6254e3ec5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:44.166579 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fce700af-3b0b-4ef5-aacb-eec6254e3ec5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:44.167004 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fce700af-3b0b-4ef5-aacb-eec6254e3ec5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:44.247584 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-fce700af-3b0b-4ef5-aacb-eec6254e3ec5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094157 Sep 20 22:28:44.248236 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 302/627] 10.222.0.16 () {58 vars in 1275 bytes} [Tue Sep 20 22:28:44 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:28:44.757392 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-2f28603e-1d19-4c49-ae05-3041acd39a0c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:44.759629 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-2f28603e-1d19-4c49-ae05-3041acd39a0c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:44.765982 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2f28603e-1d19-4c49-ae05-3041acd39a0c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:44.766467 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2f28603e-1d19-4c49-ae05-3041acd39a0c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:44.766895 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2f28603e-1d19-4c49-ae05-3041acd39a0c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:44.767580 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2f28603e-1d19-4c49-ae05-3041acd39a0c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:44.768025 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2f28603e-1d19-4c49-ae05-3041acd39a0c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:44.768442 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2f28603e-1d19-4c49-ae05-3041acd39a0c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:44.797836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-2f28603e-1d19-4c49-ae05-3041acd39a0c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044441 Sep 20 22:28:44.798590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 326/628] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:28:44 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 20 22:28:44.870866 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b99ce52e-0377-480e-aa19-d8c5e2f46b3b tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:44.872059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b99ce52e-0377-480e-aa19-d8c5e2f46b3b tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:44.880490 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b99ce52e-0377-480e-aa19-d8c5e2f46b3b tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:44.881097 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b99ce52e-0377-480e-aa19-d8c5e2f46b3b tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:44.881715 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b99ce52e-0377-480e-aa19-d8c5e2f46b3b tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:44.882426 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b99ce52e-0377-480e-aa19-d8c5e2f46b3b tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:44.883075 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b99ce52e-0377-480e-aa19-d8c5e2f46b3b tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:44.883505 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b99ce52e-0377-480e-aa19-d8c5e2f46b3b tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:44.887455 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ea215e69-0eb3-44f0-98eb-c4ba7db1add1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:44.887858 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:44.888468 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ea215e69-0eb3-44f0-98eb-c4ba7db1add1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:44.895166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ea215e69-0eb3-44f0-98eb-c4ba7db1add1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:44.895929 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ea215e69-0eb3-44f0-98eb-c4ba7db1add1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:44.896367 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ea215e69-0eb3-44f0-98eb-c4ba7db1add1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:44.897089 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ea215e69-0eb3-44f0-98eb-c4ba7db1add1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:44.897547 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ea215e69-0eb3-44f0-98eb-c4ba7db1add1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:44.897971 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ea215e69-0eb3-44f0-98eb-c4ba7db1add1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:44.923383 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ea215e69-0eb3-44f0-98eb-c4ba7db1add1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Going to try to terminate instance {{(pid=120474) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:28:44.937873 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=100 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:45.002356 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ea215e69-0eb3-44f0-98eb-c4ba7db1add1 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "DELETE /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 204 len: 0 microversion: 2.1 time: 0.119647 Sep 20 22:28:45.002860 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 327/629] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:28:44 2022] DELETE /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:28:45.011469 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4aa894ea-92ea-4f01-b9fd-d38b606ad5e6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:45.012172 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4aa894ea-92ea-4f01-b9fd-d38b606ad5e6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:45.018535 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4aa894ea-92ea-4f01-b9fd-d38b606ad5e6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:45.019022 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4aa894ea-92ea-4f01-b9fd-d38b606ad5e6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:45.019454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4aa894ea-92ea-4f01-b9fd-d38b606ad5e6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:45.020135 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4aa894ea-92ea-4f01-b9fd-d38b606ad5e6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:45.020583 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4aa894ea-92ea-4f01-b9fd-d38b606ad5e6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:45.021023 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4aa894ea-92ea-4f01-b9fd-d38b606ad5e6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:45.107694 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b99ce52e-0377-480e-aa19-d8c5e2f46b3b tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:45.116524 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b99ce52e-0377-480e-aa19-d8c5e2f46b3b tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.257045 Sep 20 22:28:45.117404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 303/630] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:44 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:45.152415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4aa894ea-92ea-4f01-b9fd-d38b606ad5e6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:45.161100 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4aa894ea-92ea-4f01-b9fd-d38b606ad5e6 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1689 microversion: 2.1 time: 0.154095 Sep 20 22:28:45.161675 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 328/631] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:45 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:45.280837 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-1dd269e2-4e64-49b3-985f-8dd4aaa03084 req-fd6a6205-b371-4460-98f8-6e707a38e952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383da7f3-a48b-45bf-aa96-d3eb43320ed0", "tag": "0cfdba0d-6995-4cd9-a5d7-8cea3b491626"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:45.291036 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-1dd269e2-4e64-49b3-985f-8dd4aaa03084 req-fd6a6205-b371-4460-98f8-6e707a38e952 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:45.291197 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-1dd269e2-4e64-49b3-985f-8dd4aaa03084 req-fd6a6205-b371-4460-98f8-6e707a38e952 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:45.291685 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-1dd269e2-4e64-49b3-985f-8dd4aaa03084 req-fd6a6205-b371-4460-98f8-6e707a38e952 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:45.302678 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-1dd269e2-4e64-49b3-985f-8dd4aaa03084 req-fd6a6205-b371-4460-98f8-6e707a38e952 service nova] Creating event network-changed:0cfdba0d-6995-4cd9-a5d7-8cea3b491626 for instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 on hv-cinder-85827 Sep 20 22:28:45.307561 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-1dd269e2-4e64-49b3-985f-8dd4aaa03084 req-fd6a6205-b371-4460-98f8-6e707a38e952 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030597 Sep 20 22:28:45.308226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 304/632] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:28:46.139699 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-11ba6f0c-f789-4ef3-a2ae-aaa806160c61 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:46.140881 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-11ba6f0c-f789-4ef3-a2ae-aaa806160c61 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:46.147677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-11ba6f0c-f789-4ef3-a2ae-aaa806160c61 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:46.148171 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-11ba6f0c-f789-4ef3-a2ae-aaa806160c61 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:46.148605 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-11ba6f0c-f789-4ef3-a2ae-aaa806160c61 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:46.149549 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-11ba6f0c-f789-4ef3-a2ae-aaa806160c61 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:46.150003 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-11ba6f0c-f789-4ef3-a2ae-aaa806160c61 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:46.150425 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-11ba6f0c-f789-4ef3-a2ae-aaa806160c61 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:46.184592 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-88a44480-e75c-4a7f-a454-5326e69438d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:46.185502 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-88a44480-e75c-4a7f-a454-5326e69438d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:46.192951 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-88a44480-e75c-4a7f-a454-5326e69438d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:46.193752 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-88a44480-e75c-4a7f-a454-5326e69438d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:46.194194 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-88a44480-e75c-4a7f-a454-5326e69438d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:46.194941 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-88a44480-e75c-4a7f-a454-5326e69438d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:46.195394 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-88a44480-e75c-4a7f-a454-5326e69438d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:46.195819 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-88a44480-e75c-4a7f-a454-5326e69438d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:46.289552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-11ba6f0c-f789-4ef3-a2ae-aaa806160c61 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:46.297623 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-11ba6f0c-f789-4ef3-a2ae-aaa806160c61 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.161709 Sep 20 22:28:46.298161 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 329/633] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:46 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:46.335525 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-88a44480-e75c-4a7f-a454-5326e69438d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:46.343017 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-88a44480-e75c-4a7f-a454-5326e69438d3 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1689 microversion: 2.1 time: 0.163094 Sep 20 22:28:46.343583 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 305/634] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:46 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:47.322545 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9209faeb-815b-4c74-82a9-34d9d43714c2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:47.323149 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9209faeb-815b-4c74-82a9-34d9d43714c2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:47.329833 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9209faeb-815b-4c74-82a9-34d9d43714c2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:47.330307 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9209faeb-815b-4c74-82a9-34d9d43714c2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:47.330731 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9209faeb-815b-4c74-82a9-34d9d43714c2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:47.331411 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9209faeb-815b-4c74-82a9-34d9d43714c2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:47.331857 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9209faeb-815b-4c74-82a9-34d9d43714c2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:47.332272 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9209faeb-815b-4c74-82a9-34d9d43714c2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:47.366402 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-75f10dba-bdfd-43a8-8dcd-618a83736da2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:47.367275 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-75f10dba-bdfd-43a8-8dcd-618a83736da2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:47.374267 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-75f10dba-bdfd-43a8-8dcd-618a83736da2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:47.374825 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-75f10dba-bdfd-43a8-8dcd-618a83736da2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:47.375332 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-75f10dba-bdfd-43a8-8dcd-618a83736da2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:47.376135 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-75f10dba-bdfd-43a8-8dcd-618a83736da2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:47.376677 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-75f10dba-bdfd-43a8-8dcd-618a83736da2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:47.377127 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-75f10dba-bdfd-43a8-8dcd-618a83736da2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:47.462289 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-9209faeb-815b-4c74-82a9-34d9d43714c2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:47.470192 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-9209faeb-815b-4c74-82a9-34d9d43714c2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.151464 Sep 20 22:28:47.470791 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 330/635] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:47 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:47.505838 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-75f10dba-bdfd-43a8-8dcd-618a83736da2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:47.513324 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-75f10dba-bdfd-43a8-8dcd-618a83736da2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1689 microversion: 2.1 time: 0.151389 Sep 20 22:28:47.513886 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 306/636] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:47 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:47.701181 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-e372b4b7-6a52-4c95-ba16-27e7e8ef9c24 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:47.701673 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-e372b4b7-6a52-4c95-ba16-27e7e8ef9c24 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:47.709429 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e372b4b7-6a52-4c95-ba16-27e7e8ef9c24 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:47.709907 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e372b4b7-6a52-4c95-ba16-27e7e8ef9c24 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:47.710335 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e372b4b7-6a52-4c95-ba16-27e7e8ef9c24 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:47.711019 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e372b4b7-6a52-4c95-ba16-27e7e8ef9c24 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:47.711466 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e372b4b7-6a52-4c95-ba16-27e7e8ef9c24 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:47.711879 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e372b4b7-6a52-4c95-ba16-27e7e8ef9c24 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:47.792146 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-e372b4b7-6a52-4c95-ba16-27e7e8ef9c24 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lazy-loading 'services' on Instance uuid 1bc14577-a081-4fbe-9687-94753644450a {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:28:47.863046 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-e372b4b7-6a52-4c95-ba16-27e7e8ef9c24 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a/os-volume_attachments/c8eb3b04-e855-4a69-ac0d-4b6cedf0e8ed" status: 202 len: 0 microversion: 2.1 time: 0.164936 Sep 20 22:28:47.863645 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 331/637] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 20 22:28:47 2022] DELETE /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a/os-volume_attachments/c8eb3b04-e855-4a69-ac0d-4b6cedf0e8ed => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:28:48.494148 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-01749b6c-b59e-4a21-a560-12e8f9dfd23a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:48.494760 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-01749b6c-b59e-4a21-a560-12e8f9dfd23a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:48.501098 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-01749b6c-b59e-4a21-a560-12e8f9dfd23a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:48.501584 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-01749b6c-b59e-4a21-a560-12e8f9dfd23a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:48.502022 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-01749b6c-b59e-4a21-a560-12e8f9dfd23a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:48.502711 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-01749b6c-b59e-4a21-a560-12e8f9dfd23a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:48.503163 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-01749b6c-b59e-4a21-a560-12e8f9dfd23a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:48.503589 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-01749b6c-b59e-4a21-a560-12e8f9dfd23a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:48.537068 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c6fdd97e-efd4-40c5-950a-ff5b3062285f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:48.537693 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-c6fdd97e-efd4-40c5-950a-ff5b3062285f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:48.543775 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c6fdd97e-efd4-40c5-950a-ff5b3062285f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:48.544254 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c6fdd97e-efd4-40c5-950a-ff5b3062285f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:48.544688 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c6fdd97e-efd4-40c5-950a-ff5b3062285f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:48.545402 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c6fdd97e-efd4-40c5-950a-ff5b3062285f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:48.545859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c6fdd97e-efd4-40c5-950a-ff5b3062285f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:48.546273 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c6fdd97e-efd4-40c5-950a-ff5b3062285f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:48.685741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-01749b6c-b59e-4a21-a560-12e8f9dfd23a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:48.694016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-c6fdd97e-efd4-40c5-950a-ff5b3062285f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:48.695337 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-01749b6c-b59e-4a21-a560-12e8f9dfd23a tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.205260 Sep 20 22:28:48.695920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 307/638] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:48 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:48.702511 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c6fdd97e-efd4-40c5-950a-ff5b3062285f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1689 microversion: 2.1 time: 0.170535 Sep 20 22:28:48.703523 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 332/639] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:48 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:49.718542 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-4dbd3fa6-2a7f-4b82-9607-9ce695fe0221 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:49.720060 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-4dbd3fa6-2a7f-4b82-9607-9ce695fe0221 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:49.725484 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4d0cff6a-2ffc-4d6b-827d-26b379a8eefb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:49.726758 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4d0cff6a-2ffc-4d6b-827d-26b379a8eefb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:49.729064 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4dbd3fa6-2a7f-4b82-9607-9ce695fe0221 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:49.729563 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4dbd3fa6-2a7f-4b82-9607-9ce695fe0221 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:49.729996 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4dbd3fa6-2a7f-4b82-9607-9ce695fe0221 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:49.731164 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4dbd3fa6-2a7f-4b82-9607-9ce695fe0221 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:49.731838 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4dbd3fa6-2a7f-4b82-9607-9ce695fe0221 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:49.733023 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4dbd3fa6-2a7f-4b82-9607-9ce695fe0221 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:49.734907 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4d0cff6a-2ffc-4d6b-827d-26b379a8eefb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:49.735661 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4d0cff6a-2ffc-4d6b-827d-26b379a8eefb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:49.736315 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4d0cff6a-2ffc-4d6b-827d-26b379a8eefb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:49.738023 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4d0cff6a-2ffc-4d6b-827d-26b379a8eefb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:49.739097 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4d0cff6a-2ffc-4d6b-827d-26b379a8eefb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:49.740062 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4d0cff6a-2ffc-4d6b-827d-26b379a8eefb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:49.884667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4d0cff6a-2ffc-4d6b-827d-26b379a8eefb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:49.893089 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4d0cff6a-2ffc-4d6b-827d-26b379a8eefb tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1689 microversion: 2.1 time: 0.171272 Sep 20 22:28:49.893720 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 333/640] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:49 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:50.063033 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-46bb2f94-d5c3-4c89-a2f5-2e973746ae26 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:50.063929 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-46bb2f94-d5c3-4c89-a2f5-2e973746ae26 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:50.070664 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-46bb2f94-d5c3-4c89-a2f5-2e973746ae26 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:50.071421 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-46bb2f94-d5c3-4c89-a2f5-2e973746ae26 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:50.072058 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-46bb2f94-d5c3-4c89-a2f5-2e973746ae26 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:50.072780 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-46bb2f94-d5c3-4c89-a2f5-2e973746ae26 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:50.073266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-46bb2f94-d5c3-4c89-a2f5-2e973746ae26 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:50.073695 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-46bb2f94-d5c3-4c89-a2f5-2e973746ae26 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:50.100996 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-46bb2f94-d5c3-4c89-a2f5-2e973746ae26 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Going to try to terminate instance {{(pid=120474) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:28:50.186867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-46bb2f94-d5c3-4c89-a2f5-2e973746ae26 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 204 len: 0 microversion: 2.1 time: 0.127840 Sep 20 22:28:50.187861 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 334/641] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:28:50 2022] DELETE /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 20 22:28:50.197416 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-46cf01b4-d07b-47f0-b897-0a9083f54f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:50.198338 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-46cf01b4-d07b-47f0-b897-0a9083f54f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:50.204205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:50.205815 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-46cf01b4-d07b-47f0-b897-0a9083f54f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:50.206909 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-46cf01b4-d07b-47f0-b897-0a9083f54f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:50.207345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-46cf01b4-d07b-47f0-b897-0a9083f54f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:50.208048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-46cf01b4-d07b-47f0-b897-0a9083f54f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:50.208502 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-46cf01b4-d07b-47f0-b897-0a9083f54f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:50.208929 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-46cf01b4-d07b-47f0-b897-0a9083f54f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:50.305581 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-4dbd3fa6-2a7f-4b82-9607-9ce695fe0221 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:50.314115 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-4dbd3fa6-2a7f-4b82-9607-9ce695fe0221 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.599709 Sep 20 22:28:50.316143 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 308/642] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:49 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:50.347267 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-46cf01b4-d07b-47f0-b897-0a9083f54f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:50.355018 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-46cf01b4-d07b-47f0-b897-0a9083f54f7b tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 200 len: 1513 microversion: 2.1 time: 0.162070 Sep 20 22:28:50.355589 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 335/643] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:50 2022] GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:50.687594 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-8177b07b-de2f-4423-8085-1b4e6f396f64 req-2d57a4f7-0835-4465-892b-c45d596d9fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704f353f-861e-47cf-9625-7210f9f1f81e", "name": "network-vif-deleted", "tag": "514d6b9b-bb67-4159-8746-002d9cc07694"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:50.697351 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-8177b07b-de2f-4423-8085-1b4e6f396f64 req-2d57a4f7-0835-4465-892b-c45d596d9fde service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:50.697829 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-8177b07b-de2f-4423-8085-1b4e6f396f64 req-2d57a4f7-0835-4465-892b-c45d596d9fde service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:50.698556 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-8177b07b-de2f-4423-8085-1b4e6f396f64 req-2d57a4f7-0835-4465-892b-c45d596d9fde service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:50.711347 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-8177b07b-de2f-4423-8085-1b4e6f396f64 req-2d57a4f7-0835-4465-892b-c45d596d9fde service nova] Creating event network-vif-deleted:514d6b9b-bb67-4159-8746-002d9cc07694 for instance 704f353f-861e-47cf-9625-7210f9f1f81e on hv-cinder-85827 Sep 20 22:28:50.716395 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-8177b07b-de2f-4423-8085-1b4e6f396f64 req-2d57a4f7-0835-4465-892b-c45d596d9fde service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032464 Sep 20 22:28:50.717017 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 309/644] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:28:50.965214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-05ea19b3-d31b-4bcd-ac1b-15e6870cba6e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:50.966189 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-05ea19b3-d31b-4bcd-ac1b-15e6870cba6e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:50.972549 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-05ea19b3-d31b-4bcd-ac1b-15e6870cba6e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:50.973057 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-05ea19b3-d31b-4bcd-ac1b-15e6870cba6e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:50.973490 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-05ea19b3-d31b-4bcd-ac1b-15e6870cba6e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:50.974166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-05ea19b3-d31b-4bcd-ac1b-15e6870cba6e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:50.974612 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-05ea19b3-d31b-4bcd-ac1b-15e6870cba6e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:50.975028 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-05ea19b3-d31b-4bcd-ac1b-15e6870cba6e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:51.036760 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-05ea19b3-d31b-4bcd-ac1b-15e6870cba6e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:51.044596 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-05ea19b3-d31b-4bcd-ac1b-15e6870cba6e tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1621 microversion: 2.1 time: 0.132074 Sep 20 22:28:51.045527 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 336/645] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:50 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1621 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:51.339745 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ab4304cb-4403-4ddf-8f28-f14af8f2ac66 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:51.340513 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ab4304cb-4403-4ddf-8f28-f14af8f2ac66 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:51.347333 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ab4304cb-4403-4ddf-8f28-f14af8f2ac66 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:51.347829 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ab4304cb-4403-4ddf-8f28-f14af8f2ac66 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:51.348264 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ab4304cb-4403-4ddf-8f28-f14af8f2ac66 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:51.348987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ab4304cb-4403-4ddf-8f28-f14af8f2ac66 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:51.349447 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ab4304cb-4403-4ddf-8f28-f14af8f2ac66 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:51.349879 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ab4304cb-4403-4ddf-8f28-f14af8f2ac66 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:51.378883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-33d91b15-03e4-4ed9-8cd2-096d0f6793dd tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:51.380065 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-33d91b15-03e4-4ed9-8cd2-096d0f6793dd tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:51.390648 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-33d91b15-03e4-4ed9-8cd2-096d0f6793dd tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:51.391140 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-33d91b15-03e4-4ed9-8cd2-096d0f6793dd tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:51.391574 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-33d91b15-03e4-4ed9-8cd2-096d0f6793dd tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:51.392307 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-33d91b15-03e4-4ed9-8cd2-096d0f6793dd tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:51.392760 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-33d91b15-03e4-4ed9-8cd2-096d0f6793dd tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:51.393208 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-33d91b15-03e4-4ed9-8cd2-096d0f6793dd tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:51.484905 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ab4304cb-4403-4ddf-8f28-f14af8f2ac66 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:51.493817 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ab4304cb-4403-4ddf-8f28-f14af8f2ac66 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.158733 Sep 20 22:28:51.494501 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 310/646] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:51 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:51.532322 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-33d91b15-03e4-4ed9-8cd2-096d0f6793dd tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:51.540588 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-33d91b15-03e4-4ed9-8cd2-096d0f6793dd tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 200 len: 1513 microversion: 2.1 time: 0.165631 Sep 20 22:28:51.541345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 337/647] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:51 2022] GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:52.068922 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0b32cca9-fe1a-46df-960e-bd8ec7249462 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:52.069994 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-0b32cca9-fe1a-46df-960e-bd8ec7249462 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:52.076872 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0b32cca9-fe1a-46df-960e-bd8ec7249462 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:52.077724 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0b32cca9-fe1a-46df-960e-bd8ec7249462 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:52.078386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0b32cca9-fe1a-46df-960e-bd8ec7249462 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:52.079462 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0b32cca9-fe1a-46df-960e-bd8ec7249462 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:52.080020 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0b32cca9-fe1a-46df-960e-bd8ec7249462 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:52.080603 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0b32cca9-fe1a-46df-960e-bd8ec7249462 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:52.117369 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0b32cca9-fe1a-46df-960e-bd8ec7249462 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:52.117878 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0b32cca9-fe1a-46df-960e-bd8ec7249462 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:52.118334 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0b32cca9-fe1a-46df-960e-bd8ec7249462 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:52.118804 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-0b32cca9-fe1a-46df-960e-bd8ec7249462 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lazy-loading 'fault' on Instance uuid 704f353f-861e-47cf-9625-7210f9f1f81e {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:28:52.181415 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-0b32cca9-fe1a-46df-960e-bd8ec7249462 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:52.189460 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-0b32cca9-fe1a-46df-960e-bd8ec7249462 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1335 microversion: 2.1 time: 0.125268 Sep 20 22:28:52.191044 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 311/648] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:52 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1335 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:52.518249 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b27620c0-d1dd-417f-9cc8-362b31fd62dd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:52.518882 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b27620c0-d1dd-417f-9cc8-362b31fd62dd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:52.525441 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b27620c0-d1dd-417f-9cc8-362b31fd62dd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:52.525924 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b27620c0-d1dd-417f-9cc8-362b31fd62dd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:52.526359 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b27620c0-d1dd-417f-9cc8-362b31fd62dd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:52.527044 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b27620c0-d1dd-417f-9cc8-362b31fd62dd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:52.527491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b27620c0-d1dd-417f-9cc8-362b31fd62dd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:52.527906 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b27620c0-d1dd-417f-9cc8-362b31fd62dd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:52.563614 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-29d7c53d-00d7-4a0f-b76b-2f5a208ca9b1 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:52.564804 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-29d7c53d-00d7-4a0f-b76b-2f5a208ca9b1 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:52.571369 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-29d7c53d-00d7-4a0f-b76b-2f5a208ca9b1 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:52.571838 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-29d7c53d-00d7-4a0f-b76b-2f5a208ca9b1 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:52.572271 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-29d7c53d-00d7-4a0f-b76b-2f5a208ca9b1 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:52.572987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-29d7c53d-00d7-4a0f-b76b-2f5a208ca9b1 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:52.573443 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-29d7c53d-00d7-4a0f-b76b-2f5a208ca9b1 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:52.573860 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-29d7c53d-00d7-4a0f-b76b-2f5a208ca9b1 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:52.635972 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-29d7c53d-00d7-4a0f-b76b-2f5a208ca9b1 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:52.644149 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-29d7c53d-00d7-4a0f-b76b-2f5a208ca9b1 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 200 len: 1471 microversion: 2.1 time: 0.083767 Sep 20 22:28:52.644725 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 312/649] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:52 2022] GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 1471 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:28:52.661349 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b27620c0-d1dd-417f-9cc8-362b31fd62dd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:52.669226 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b27620c0-d1dd-417f-9cc8-362b31fd62dd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.154798 Sep 20 22:28:52.669796 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 338/650] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:52 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:52.731044 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-7a16141e-3811-492f-8c14-834a0c9dcf01 req-69f89f6c-92a7-48cd-b69f-1405b8f0a6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc14577-a081-4fbe-9687-94753644450a", "name": "network-vif-deleted", "tag": "35caed36-f226-4dcb-909b-d6cf62599c3e"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:52.735950 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:52.741545 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-7a16141e-3811-492f-8c14-834a0c9dcf01 req-69f89f6c-92a7-48cd-b69f-1405b8f0a6d9 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:52.742276 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-7a16141e-3811-492f-8c14-834a0c9dcf01 req-69f89f6c-92a7-48cd-b69f-1405b8f0a6d9 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:52.742694 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-7a16141e-3811-492f-8c14-834a0c9dcf01 req-69f89f6c-92a7-48cd-b69f-1405b8f0a6d9 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:52.753678 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-7a16141e-3811-492f-8c14-834a0c9dcf01 req-69f89f6c-92a7-48cd-b69f-1405b8f0a6d9 service nova] Creating event network-vif-deleted:35caed36-f226-4dcb-909b-d6cf62599c3e for instance 1bc14577-a081-4fbe-9687-94753644450a on hv-cinder-85827 Sep 20 22:28:52.758837 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-7a16141e-3811-492f-8c14-834a0c9dcf01 req-69f89f6c-92a7-48cd-b69f-1405b8f0a6d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031566 Sep 20 22:28:52.759397 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 313/651] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:28:53.213094 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-8b1a4f2e-cf73-487e-ba7d-8b5897469930 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:53.213703 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-8b1a4f2e-cf73-487e-ba7d-8b5897469930 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:53.219676 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b1a4f2e-cf73-487e-ba7d-8b5897469930 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:53.220157 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b1a4f2e-cf73-487e-ba7d-8b5897469930 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:53.220598 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b1a4f2e-cf73-487e-ba7d-8b5897469930 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:53.221384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b1a4f2e-cf73-487e-ba7d-8b5897469930 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:53.221839 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b1a4f2e-cf73-487e-ba7d-8b5897469930 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:53.222286 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b1a4f2e-cf73-487e-ba7d-8b5897469930 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:53.251735 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b1a4f2e-cf73-487e-ba7d-8b5897469930 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:53.252210 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b1a4f2e-cf73-487e-ba7d-8b5897469930 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:53.253232 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b1a4f2e-cf73-487e-ba7d-8b5897469930 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:53.253678 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-8b1a4f2e-cf73-487e-ba7d-8b5897469930 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lazy-loading 'fault' on Instance uuid 704f353f-861e-47cf-9625-7210f9f1f81e {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:28:53.296261 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-8b1a4f2e-cf73-487e-ba7d-8b5897469930 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:53.304286 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-8b1a4f2e-cf73-487e-ba7d-8b5897469930 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 200 len: 1335 microversion: 2.1 time: 0.095093 Sep 20 22:28:53.304845 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 339/652] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:53 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 1335 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:53.669155 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-21c43f63-efe4-4a0a-a695-2526830408a8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:53.669866 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-21c43f63-efe4-4a0a-a695-2526830408a8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:53.677681 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-21c43f63-efe4-4a0a-a695-2526830408a8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:53.678181 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-21c43f63-efe4-4a0a-a695-2526830408a8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:53.678625 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-21c43f63-efe4-4a0a-a695-2526830408a8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:53.679329 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-21c43f63-efe4-4a0a-a695-2526830408a8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:53.679974 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-21c43f63-efe4-4a0a-a695-2526830408a8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:53.680439 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-21c43f63-efe4-4a0a-a695-2526830408a8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:53.693948 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-dd6df0a0-d4c4-46ac-9d8e-9453a0c31854 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:53.695452 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-dd6df0a0-d4c4-46ac-9d8e-9453a0c31854 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:53.703402 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dd6df0a0-d4c4-46ac-9d8e-9453a0c31854 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:53.704052 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dd6df0a0-d4c4-46ac-9d8e-9453a0c31854 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:53.704555 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dd6df0a0-d4c4-46ac-9d8e-9453a0c31854 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:53.705499 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dd6df0a0-d4c4-46ac-9d8e-9453a0c31854 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:53.705985 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dd6df0a0-d4c4-46ac-9d8e-9453a0c31854 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:53.706409 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dd6df0a0-d4c4-46ac-9d8e-9453a0c31854 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:53.727675 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:53.755379 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-21c43f63-efe4-4a0a-a695-2526830408a8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '427aa58e5bb74f65afa75037c9e70f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef004c556b540e28aafe07418fe8e30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:53.763250 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-21c43f63-efe4-4a0a-a695-2526830408a8 tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 200 len: 1303 microversion: 2.1 time: 0.099139 Sep 20 22:28:53.763825 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 314/653] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:53 2022] GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:53.847699 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-dd6df0a0-d4c4-46ac-9d8e-9453a0c31854 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:53.855343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-dd6df0a0-d4c4-46ac-9d8e-9453a0c31854 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.167426 Sep 20 22:28:53.855852 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 340/654] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:53 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:54.327241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ce0a3b3e-0fec-4d63-a034-04396e7464d2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:54.327878 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ce0a3b3e-0fec-4d63-a034-04396e7464d2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 704f353f-861e-47cf-9625-7210f9f1f81e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:54.334285 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ce0a3b3e-0fec-4d63-a034-04396e7464d2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:54.334765 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ce0a3b3e-0fec-4d63-a034-04396e7464d2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:54.335198 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ce0a3b3e-0fec-4d63-a034-04396e7464d2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:54.335878 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ce0a3b3e-0fec-4d63-a034-04396e7464d2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:54.336328 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ce0a3b3e-0fec-4d63-a034-04396e7464d2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:54.336745 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ce0a3b3e-0fec-4d63-a034-04396e7464d2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:54.350719 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-ce0a3b3e-0fec-4d63-a034-04396e7464d2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] HTTP exception thrown: Instance 704f353f-861e-47cf-9625-7210f9f1f81e could not be found. Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ce0a3b3e-0fec-4d63-a034-04396e7464d2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Request method failure captured: Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e HTTP/1.1 Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj121zgLwFJmRdY8P7mlmZ0v-f9HObvaDYJxym52l22Y024SfHGWFrqhydZ0ZORQZ7-32KLCyqBkv_IlwCXlVT0i8YM1I13VcrEKJTKuP6ul-aOq7DYohb9IE3g2mh3VHvoeTrM31ytaLizPn4LX9RAhk2JxUd9tYcXBoVxsD6N2zWY Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: e1076a54706448038779945f53703345 Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-475540964 Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:28:54.352368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:28:54.353988 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e1076a54706448038779945f53703345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e1076a54706448038779945f53703345", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e1076a54706448038779945f53703345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e1076a54706448038779945f53703345"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:28:54.353988 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-ServerRescueNegativeTestJSON-475540964 Sep 20 22:28:54.353988 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: e1076a54706448038779945f53703345 Sep 20 22:28:54.353988 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-475540964 Sep 20 22:28:54.353988 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-ServerRescueNegativeTestJSON-475540964-project Sep 20 22:28:54.353988 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:28:54.353988 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:28:54.353988 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 55ab0d396ace494c8884d21d41a04e72 Sep 20 22:28:54.353988 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-ServerRescueNegativeTestJSON-475540964-project Sep 20 22:28:54.353988 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:28:54.353988 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance 704f353f-861e-47cf-9625-7210f9f1f81e could not be found. Sep 20 22:28:54.353988 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': '704f353f-861e-47cf-9625-7210f9f1f81e'} Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 704f353f-861e-47cf-9625-7210f9f1f81e could not be found. Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:28:54.355078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:28:54.356386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:28:54.356386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:28:54.356386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:28:54.356386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:28:54.356386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:28:54.356386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:28:54.356386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:28:54.356386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 704f353f-861e-47cf-9625-7210f9f1f81e could not be found. Sep 20 22:28:54.356386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:54.356386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:28:54.356386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:54.356386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:28:54.356386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:28:54.356386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:28:54.356386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:28:54.356386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:28:54.356386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 704f353f-861e-47cf-9625-7210f9f1f81e could not be found. Sep 20 22:28:54.356386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:54.358463 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ce0a3b3e-0fec-4d63-a034-04396e7464d2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Returning 404 to user: Instance 704f353f-861e-47cf-9625-7210f9f1f81e could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:28:54.358463 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ce0a3b3e-0fec-4d63-a034-04396e7464d2 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e" status: 404 len: 111 microversion: 2.1 time: 0.030450 Sep 20 22:28:54.358463 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 315/655] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:54 2022] GET /compute/v2.1/servers/704f353f-861e-47cf-9625-7210f9f1f81e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:28:54.362683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-da9cc8cb-f0c8-4026-8b61-c108c04d0b10 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '.version_select at 0x7f24f6739d30>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:54.382013 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-da9cc8cb-f0c8-4026-8b61-c108c04d0b10 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-951626438" status: 202 len: 0 microversion: 2.1 time: 0.023131 Sep 20 22:28:54.382690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 341/656] 10.222.0.16 () {58 vars in 1218 bytes} [Tue Sep 20 22:28:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-951626438 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:28:54.787365 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6f24303e-2256-40a9-82d8-96644587573a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:54.788628 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-6f24303e-2256-40a9-82d8-96644587573a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] [instance: 1bc14577-a081-4fbe-9687-94753644450a] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:54.795801 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6f24303e-2256-40a9-82d8-96644587573a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:54.796362 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6f24303e-2256-40a9-82d8-96644587573a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:54.796802 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6f24303e-2256-40a9-82d8-96644587573a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:54.797528 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6f24303e-2256-40a9-82d8-96644587573a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:54.797981 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6f24303e-2256-40a9-82d8-96644587573a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:54.798429 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6f24303e-2256-40a9-82d8-96644587573a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:54.813666 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-6f24303e-2256-40a9-82d8-96644587573a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] HTTP exception thrown: Instance 1bc14577-a081-4fbe-9687-94753644450a could not be found. Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6f24303e-2256-40a9-82d8-96644587573a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Request method failure captured: Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a HTTP/1.1 Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj4rE8aTk9XQilv-xRSuCCl42yNXtAKGVbxETAq7nWHmpkLlmB4KH7Gm3XQGfs7RzSsK_Yd0_bq3gz-4xynpox_1o_EZN7qRIFjBEbrbfd1f45poTqziIk5ROYUkOwak_2M8SWBYFsceH4og2kwr7w82Aa_o_TIy5ezfOQXvK_9SV9I Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: bef004c556b540e28aafe07418fe8e30 Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-VolumesSnapshotTestJSON-576134153 Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:28:54.817661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:28:54.818998 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bef004c556b540e28aafe07418fe8e30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bef004c556b540e28aafe07418fe8e30", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bef004c556b540e28aafe07418fe8e30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bef004c556b540e28aafe07418fe8e30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:28:54.818998 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-VolumesSnapshotTestJSON-576134153 Sep 20 22:28:54.818998 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: bef004c556b540e28aafe07418fe8e30 Sep 20 22:28:54.818998 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-576134153 Sep 20 22:28:54.818998 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-VolumesSnapshotTestJSON-576134153-project Sep 20 22:28:54.818998 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:28:54.818998 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:28:54.818998 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 427aa58e5bb74f65afa75037c9e70f80 Sep 20 22:28:54.818998 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-VolumesSnapshotTestJSON-576134153-project Sep 20 22:28:54.818998 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:28:54.818998 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance 1bc14577-a081-4fbe-9687-94753644450a could not be found. Sep 20 22:28:54.818998 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': '1bc14577-a081-4fbe-9687-94753644450a'} Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc14577-a081-4fbe-9687-94753644450a could not be found. Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:28:54.819716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:28:54.821277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:28:54.821277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:28:54.821277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:28:54.821277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:28:54.821277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:28:54.821277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:28:54.821277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:28:54.821277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc14577-a081-4fbe-9687-94753644450a could not be found. Sep 20 22:28:54.821277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:54.821277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:28:54.821277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:54.821277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:28:54.821277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:28:54.821277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:28:54.821277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:28:54.821277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:28:54.821277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc14577-a081-4fbe-9687-94753644450a could not be found. Sep 20 22:28:54.821277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:28:54.822482 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6f24303e-2256-40a9-82d8-96644587573a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] Returning 404 to user: Instance 1bc14577-a081-4fbe-9687-94753644450a could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:28:54.822482 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-6f24303e-2256-40a9-82d8-96644587573a tempest-VolumesSnapshotTestJSON-576134153 tempest-VolumesSnapshotTestJSON-576134153-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a" status: 404 len: 111 microversion: 2.1 time: 0.037147 Sep 20 22:28:54.822482 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 316/657] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:54 2022] GET /compute/v2.1/servers/1bc14577-a081-4fbe-9687-94753644450a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:28:54.878914 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-d968dbbe-5a49-4466-9e0c-610d17dee257 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:54.879552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-d968dbbe-5a49-4466-9e0c-610d17dee257 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:54.886724 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d968dbbe-5a49-4466-9e0c-610d17dee257 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:54.888781 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d968dbbe-5a49-4466-9e0c-610d17dee257 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:54.889261 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d968dbbe-5a49-4466-9e0c-610d17dee257 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:54.890175 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d968dbbe-5a49-4466-9e0c-610d17dee257 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:54.890820 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d968dbbe-5a49-4466-9e0c-610d17dee257 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:54.891402 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d968dbbe-5a49-4466-9e0c-610d17dee257 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:55.125605 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-d968dbbe-5a49-4466-9e0c-610d17dee257 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:55.134431 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-d968dbbe-5a49-4466-9e0c-610d17dee257 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1570 microversion: 2.1 time: 0.259835 Sep 20 22:28:55.140825 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 342/658] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:54 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1570 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:55.157911 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c314de98-2987-4252-9a7a-b1112b4e413f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:55.159185 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c314de98-2987-4252-9a7a-b1112b4e413f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:55.166639 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c314de98-2987-4252-9a7a-b1112b4e413f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:55.167434 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c314de98-2987-4252-9a7a-b1112b4e413f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:55.168732 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c314de98-2987-4252-9a7a-b1112b4e413f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:55.169537 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c314de98-2987-4252-9a7a-b1112b4e413f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:55.170102 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c314de98-2987-4252-9a7a-b1112b4e413f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:55.170771 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c314de98-2987-4252-9a7a-b1112b4e413f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:55.213382 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c314de98-2987-4252-9a7a-b1112b4e413f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120473) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 20 22:28:55.292582 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-c314de98-2987-4252-9a7a-b1112b4e413f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "POST /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be/action" status: 202 len: 0 microversion: 2.1 time: 0.138892 Sep 20 22:28:55.293382 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 317/659] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 20 22:28:55 2022] POST /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:28:55.302006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-40666acc-0958-447e-90d0-0e97ebcc88b5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:55.302623 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-40666acc-0958-447e-90d0-0e97ebcc88b5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:55.308758 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-40666acc-0958-447e-90d0-0e97ebcc88b5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:55.309278 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-40666acc-0958-447e-90d0-0e97ebcc88b5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:55.309721 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-40666acc-0958-447e-90d0-0e97ebcc88b5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:55.310417 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-40666acc-0958-447e-90d0-0e97ebcc88b5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:55.310873 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-40666acc-0958-447e-90d0-0e97ebcc88b5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:55.311305 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-40666acc-0958-447e-90d0-0e97ebcc88b5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:55.451448 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-40666acc-0958-447e-90d0-0e97ebcc88b5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:55.459343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-40666acc-0958-447e-90d0-0e97ebcc88b5 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1518 microversion: 2.1 time: 0.161726 Sep 20 22:28:55.459932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 343/660] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:55 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:56.485563 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-de3a8eb3-b0dc-44cb-8baa-527d08d3358c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:56.486207 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-de3a8eb3-b0dc-44cb-8baa-527d08d3358c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:56.499171 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-de3a8eb3-b0dc-44cb-8baa-527d08d3358c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:56.499677 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-de3a8eb3-b0dc-44cb-8baa-527d08d3358c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:56.500122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-de3a8eb3-b0dc-44cb-8baa-527d08d3358c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:56.500842 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-de3a8eb3-b0dc-44cb-8baa-527d08d3358c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:56.501326 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-de3a8eb3-b0dc-44cb-8baa-527d08d3358c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:56.501754 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-de3a8eb3-b0dc-44cb-8baa-527d08d3358c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:56.638761 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-de3a8eb3-b0dc-44cb-8baa-527d08d3358c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:56.646544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-de3a8eb3-b0dc-44cb-8baa-527d08d3358c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1520 microversion: 2.1 time: 0.166855 Sep 20 22:28:56.647136 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 318/661] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:56 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:57.670829 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-14536bdf-3804-4854-bef2-964686986161 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:57.671373 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-14536bdf-3804-4854-bef2-964686986161 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:57.678512 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-14536bdf-3804-4854-bef2-964686986161 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:57.678990 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-14536bdf-3804-4854-bef2-964686986161 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:57.679420 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-14536bdf-3804-4854-bef2-964686986161 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:57.680102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-14536bdf-3804-4854-bef2-964686986161 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:57.680547 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-14536bdf-3804-4854-bef2-964686986161 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:57.680963 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-14536bdf-3804-4854-bef2-964686986161 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:57.809533 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-14536bdf-3804-4854-bef2-964686986161 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:57.817790 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-14536bdf-3804-4854-bef2-964686986161 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1520 microversion: 2.1 time: 0.151007 Sep 20 22:28:57.818353 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 344/662] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:57 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:58.840574 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ff999844-a710-4204-bf31-c74a1c98da7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:58.841140 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ff999844-a710-4204-bf31-c74a1c98da7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:58.848157 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ff999844-a710-4204-bf31-c74a1c98da7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:58.848638 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ff999844-a710-4204-bf31-c74a1c98da7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:58.849104 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ff999844-a710-4204-bf31-c74a1c98da7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:58.849795 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ff999844-a710-4204-bf31-c74a1c98da7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:58.850248 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ff999844-a710-4204-bf31-c74a1c98da7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:58.850675 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ff999844-a710-4204-bf31-c74a1c98da7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:58.980462 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ff999844-a710-4204-bf31-c74a1c98da7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:58.988086 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ff999844-a710-4204-bf31-c74a1c98da7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1520 microversion: 2.1 time: 0.151414 Sep 20 22:28:58.988658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 319/663] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:58 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:28:59.331090 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-665587fa-2806-4e59-b113-5b31234f41b4 req-b0d8ee9a-b59b-41ee-8ca4-27dcdbb63c8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a507bbd4-a0a2-4ca8-b04a-1511797060be", "name": "network-vif-unplugged", "status": "completed", "tag": "87454e86-c277-4775-8223-737852068e10"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:28:59.342355 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-665587fa-2806-4e59-b113-5b31234f41b4 req-b0d8ee9a-b59b-41ee-8ca4-27dcdbb63c8d service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:59.343180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-665587fa-2806-4e59-b113-5b31234f41b4 req-b0d8ee9a-b59b-41ee-8ca4-27dcdbb63c8d service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:59.343884 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-665587fa-2806-4e59-b113-5b31234f41b4 req-b0d8ee9a-b59b-41ee-8ca4-27dcdbb63c8d service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:59.357545 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-665587fa-2806-4e59-b113-5b31234f41b4 req-b0d8ee9a-b59b-41ee-8ca4-27dcdbb63c8d service nova] Creating event network-vif-unplugged:87454e86-c277-4775-8223-737852068e10 for instance a507bbd4-a0a2-4ca8-b04a-1511797060be on hv-cinder-85827 Sep 20 22:28:59.363137 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-665587fa-2806-4e59-b113-5b31234f41b4 req-b0d8ee9a-b59b-41ee-8ca4-27dcdbb63c8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036210 Sep 20 22:28:59.363725 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 345/664] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:28:59.635997 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-96169c6c-1ec8-4b88-a546-7a00e21d4a43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:59.636597 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-96169c6c-1ec8-4b88-a546-7a00e21d4a43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:59.642934 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-96169c6c-1ec8-4b88-a546-7a00e21d4a43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:59.643911 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-96169c6c-1ec8-4b88-a546-7a00e21d4a43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:59.644341 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-96169c6c-1ec8-4b88-a546-7a00e21d4a43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:59.645053 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-96169c6c-1ec8-4b88-a546-7a00e21d4a43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:59.645508 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-96169c6c-1ec8-4b88-a546-7a00e21d4a43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:59.645927 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-96169c6c-1ec8-4b88-a546-7a00e21d4a43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:59.671416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-96169c6c-1ec8-4b88-a546-7a00e21d4a43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Going to try to terminate instance {{(pid=120473) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:28:59.707379 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:59.754947 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-96169c6c-1ec8-4b88-a546-7a00e21d4a43 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 204 len: 0 microversion: 2.1 time: 0.123482 Sep 20 22:28:59.755602 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 320/665] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:28:59 2022] DELETE /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 20 22:28:59.770785 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-73978734-dce4-4ed6-bf11-e06b833c65ff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:28:59.773202 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-73978734-dce4-4ed6-bf11-e06b833c65ff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:28:59.792262 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-73978734-dce4-4ed6-bf11-e06b833c65ff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:59.793744 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-73978734-dce4-4ed6-bf11-e06b833c65ff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:59.794983 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-73978734-dce4-4ed6-bf11-e06b833c65ff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:59.795981 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-73978734-dce4-4ed6-bf11-e06b833c65ff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:28:59.796665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-73978734-dce4-4ed6-bf11-e06b833c65ff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:28:59.797388 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-73978734-dce4-4ed6-bf11-e06b833c65ff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:28:59.934316 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-73978734-dce4-4ed6-bf11-e06b833c65ff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:28:59.942786 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-73978734-dce4-4ed6-bf11-e06b833c65ff tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1506 microversion: 2.1 time: 0.182738 Sep 20 22:28:59.943361 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 346/666] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:28:59 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:00.012323 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8fb477c9-f1d4-4383-bff4-d1bc5ff0454c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:00.012934 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8fb477c9-f1d4-4383-bff4-d1bc5ff0454c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:00.019580 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8fb477c9-f1d4-4383-bff4-d1bc5ff0454c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:00.020058 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8fb477c9-f1d4-4383-bff4-d1bc5ff0454c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:00.020539 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8fb477c9-f1d4-4383-bff4-d1bc5ff0454c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:00.021371 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8fb477c9-f1d4-4383-bff4-d1bc5ff0454c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:00.021821 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8fb477c9-f1d4-4383-bff4-d1bc5ff0454c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:00.022241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8fb477c9-f1d4-4383-bff4-d1bc5ff0454c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:00.153555 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-8fb477c9-f1d4-4383-bff4-d1bc5ff0454c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:00.161138 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-8fb477c9-f1d4-4383-bff4-d1bc5ff0454c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1576 microversion: 2.1 time: 0.153106 Sep 20 22:29:00.161734 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 321/667] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:00 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:00.965815 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ee8ecffa-0f66-4b1a-92ed-44908ec80c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:00.966432 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ee8ecffa-0f66-4b1a-92ed-44908ec80c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:00.973429 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ee8ecffa-0f66-4b1a-92ed-44908ec80c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:00.973917 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ee8ecffa-0f66-4b1a-92ed-44908ec80c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:00.974350 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ee8ecffa-0f66-4b1a-92ed-44908ec80c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:00.975045 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ee8ecffa-0f66-4b1a-92ed-44908ec80c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:00.975497 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ee8ecffa-0f66-4b1a-92ed-44908ec80c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:00.975917 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ee8ecffa-0f66-4b1a-92ed-44908ec80c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:01.106098 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ee8ecffa-0f66-4b1a-92ed-44908ec80c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:01.113793 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ee8ecffa-0f66-4b1a-92ed-44908ec80c27 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1506 microversion: 2.1 time: 0.151917 Sep 20 22:29:01.114360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 347/668] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:00 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:01.184092 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6c50ab79-2b63-4423-b562-582fc99b9ac3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:01.184704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-6c50ab79-2b63-4423-b562-582fc99b9ac3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:01.191779 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6c50ab79-2b63-4423-b562-582fc99b9ac3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:01.192256 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6c50ab79-2b63-4423-b562-582fc99b9ac3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:01.192687 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6c50ab79-2b63-4423-b562-582fc99b9ac3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:01.193441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6c50ab79-2b63-4423-b562-582fc99b9ac3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:01.193887 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6c50ab79-2b63-4423-b562-582fc99b9ac3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:01.194313 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6c50ab79-2b63-4423-b562-582fc99b9ac3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:01.329362 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-6c50ab79-2b63-4423-b562-582fc99b9ac3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:01.337835 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-6c50ab79-2b63-4423-b562-582fc99b9ac3 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1576 microversion: 2.1 time: 0.158036 Sep 20 22:29:01.338406 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 322/669] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:01 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:02.136446 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-7dbc9dff-83d5-4bbd-85c4-4509531f0fa9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:02.137137 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-7dbc9dff-83d5-4bbd-85c4-4509531f0fa9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:02.143669 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7dbc9dff-83d5-4bbd-85c4-4509531f0fa9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:02.144158 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7dbc9dff-83d5-4bbd-85c4-4509531f0fa9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:02.144597 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7dbc9dff-83d5-4bbd-85c4-4509531f0fa9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:02.145323 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7dbc9dff-83d5-4bbd-85c4-4509531f0fa9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:02.145782 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7dbc9dff-83d5-4bbd-85c4-4509531f0fa9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:02.146204 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7dbc9dff-83d5-4bbd-85c4-4509531f0fa9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:02.290451 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-7dbc9dff-83d5-4bbd-85c4-4509531f0fa9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:02.298776 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-7dbc9dff-83d5-4bbd-85c4-4509531f0fa9 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1506 microversion: 2.1 time: 0.166149 Sep 20 22:29:02.299975 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 348/670] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:02 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:02.361005 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a6c0de78-cc2b-46c6-a965-2760470f4742 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:02.362418 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a6c0de78-cc2b-46c6-a965-2760470f4742 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:02.369519 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a6c0de78-cc2b-46c6-a965-2760470f4742 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:02.370533 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a6c0de78-cc2b-46c6-a965-2760470f4742 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:02.371173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a6c0de78-cc2b-46c6-a965-2760470f4742 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:02.372043 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a6c0de78-cc2b-46c6-a965-2760470f4742 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:02.372642 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a6c0de78-cc2b-46c6-a965-2760470f4742 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:02.373247 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a6c0de78-cc2b-46c6-a965-2760470f4742 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:02.549427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a6c0de78-cc2b-46c6-a965-2760470f4742 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:02.558019 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a6c0de78-cc2b-46c6-a965-2760470f4742 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1576 microversion: 2.1 time: 0.200844 Sep 20 22:29:02.558596 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 323/671] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:02 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:03.105612 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-19e3da2a-9adc-43d0-8a7a-708487eda087 req-588f1b93-9d61-45b5-b46d-d17fe66487a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc70c4c-17f0-432f-a168-0e8a0cfadf49", "name": "network-vif-deleted", "tag": "a021146d-28cd-4ea4-a592-2293bed5bd15"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:29:03.118044 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-19e3da2a-9adc-43d0-8a7a-708487eda087 req-588f1b93-9d61-45b5-b46d-d17fe66487a9 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:03.118447 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-19e3da2a-9adc-43d0-8a7a-708487eda087 req-588f1b93-9d61-45b5-b46d-d17fe66487a9 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:03.118873 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-19e3da2a-9adc-43d0-8a7a-708487eda087 req-588f1b93-9d61-45b5-b46d-d17fe66487a9 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:03.130284 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-19e3da2a-9adc-43d0-8a7a-708487eda087 req-588f1b93-9d61-45b5-b46d-d17fe66487a9 service nova] Creating event network-vif-deleted:a021146d-28cd-4ea4-a592-2293bed5bd15 for instance bfc70c4c-17f0-432f-a168-0e8a0cfadf49 on hv-cinder-85827 Sep 20 22:29:03.135257 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-19e3da2a-9adc-43d0-8a7a-708487eda087 req-588f1b93-9d61-45b5-b46d-d17fe66487a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038749 Sep 20 22:29:03.135874 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 349/672] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:29:03.322309 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-96e48df7-e58e-468f-a7f4-5ae953a9dfa0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:03.323001 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-96e48df7-e58e-468f-a7f4-5ae953a9dfa0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:03.329092 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-96e48df7-e58e-468f-a7f4-5ae953a9dfa0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:03.329581 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-96e48df7-e58e-468f-a7f4-5ae953a9dfa0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:03.330020 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-96e48df7-e58e-468f-a7f4-5ae953a9dfa0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:03.330744 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-96e48df7-e58e-468f-a7f4-5ae953a9dfa0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:03.331199 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-96e48df7-e58e-468f-a7f4-5ae953a9dfa0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:03.331620 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-96e48df7-e58e-468f-a7f4-5ae953a9dfa0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:03.363708 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-96e48df7-e58e-468f-a7f4-5ae953a9dfa0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:03.364296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-96e48df7-e58e-468f-a7f4-5ae953a9dfa0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:03.364761 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-96e48df7-e58e-468f-a7f4-5ae953a9dfa0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:03.365244 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-96e48df7-e58e-468f-a7f4-5ae953a9dfa0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lazy-loading 'fault' on Instance uuid bfc70c4c-17f0-432f-a168-0e8a0cfadf49 {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:29:03.410144 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-96e48df7-e58e-468f-a7f4-5ae953a9dfa0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:03.417928 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-96e48df7-e58e-468f-a7f4-5ae953a9dfa0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 200 len: 1311 microversion: 2.1 time: 0.099502 Sep 20 22:29:03.418518 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 324/673] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:03 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:03.581615 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f80afc20-52b4-4575-986f-0c4f79efabb6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:03.582429 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-f80afc20-52b4-4575-986f-0c4f79efabb6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:03.588941 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f80afc20-52b4-4575-986f-0c4f79efabb6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:03.589719 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f80afc20-52b4-4575-986f-0c4f79efabb6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:03.590487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f80afc20-52b4-4575-986f-0c4f79efabb6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:03.591270 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f80afc20-52b4-4575-986f-0c4f79efabb6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:03.591717 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f80afc20-52b4-4575-986f-0c4f79efabb6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:03.592372 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f80afc20-52b4-4575-986f-0c4f79efabb6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:03.739959 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-f80afc20-52b4-4575-986f-0c4f79efabb6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:03.748720 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-f80afc20-52b4-4575-986f-0c4f79efabb6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1576 microversion: 2.1 time: 0.171338 Sep 20 22:29:03.749598 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 350/674] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:03 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:04.441665 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-dd2274b6-5f77-42eb-8dd3-722c25d4e8c0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:04.442267 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-dd2274b6-5f77-42eb-8dd3-722c25d4e8c0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: bfc70c4c-17f0-432f-a168-0e8a0cfadf49] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:04.448717 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dd2274b6-5f77-42eb-8dd3-722c25d4e8c0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:04.449226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dd2274b6-5f77-42eb-8dd3-722c25d4e8c0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:04.449663 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dd2274b6-5f77-42eb-8dd3-722c25d4e8c0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:04.450347 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dd2274b6-5f77-42eb-8dd3-722c25d4e8c0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:04.450832 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dd2274b6-5f77-42eb-8dd3-722c25d4e8c0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:04.451251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dd2274b6-5f77-42eb-8dd3-722c25d4e8c0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:04.464331 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-dd2274b6-5f77-42eb-8dd3-722c25d4e8c0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] HTTP exception thrown: Instance bfc70c4c-17f0-432f-a168-0e8a0cfadf49 could not be found. Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-dd2274b6-5f77-42eb-8dd3-722c25d4e8c0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Request method failure captured: Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 HTTP/1.1 Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj121zgLwFJmRdY8P7mlmZ0v-f9HObvaDYJxym52l22Y024SfHGWFrqhydZ0ZORQZ7-32KLCyqBkv_IlwCXlVT0i8YM1I13VcrEKJTKuP6ul-aOq7DYohb9IE3g2mh3VHvoeTrM31ytaLizPn4LX9RAhk2JxUd9tYcXBoVxsD6N2zWY Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: e1076a54706448038779945f53703345 Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-475540964 Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:29:04.465949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:29:04.467305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e1076a54706448038779945f53703345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e1076a54706448038779945f53703345", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e1076a54706448038779945f53703345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e1076a54706448038779945f53703345"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:29:04.467305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-ServerRescueNegativeTestJSON-475540964 Sep 20 22:29:04.467305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: e1076a54706448038779945f53703345 Sep 20 22:29:04.467305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-475540964 Sep 20 22:29:04.467305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-ServerRescueNegativeTestJSON-475540964-project Sep 20 22:29:04.467305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:29:04.467305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:29:04.467305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 55ab0d396ace494c8884d21d41a04e72 Sep 20 22:29:04.467305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-ServerRescueNegativeTestJSON-475540964-project Sep 20 22:29:04.467305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:29:04.467305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance bfc70c4c-17f0-432f-a168-0e8a0cfadf49 could not be found. Sep 20 22:29:04.467305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': 'bfc70c4c-17f0-432f-a168-0e8a0cfadf49'} Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfc70c4c-17f0-432f-a168-0e8a0cfadf49 could not be found. Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:29:04.468059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:29:04.469595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:29:04.469595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:29:04.469595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:29:04.469595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:29:04.469595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:29:04.469595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:29:04.469595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:29:04.469595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfc70c4c-17f0-432f-a168-0e8a0cfadf49 could not be found. Sep 20 22:29:04.469595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:04.469595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:29:04.469595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:04.469595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:04.469595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:29:04.469595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:29:04.469595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:29:04.469595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:29:04.469595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfc70c4c-17f0-432f-a168-0e8a0cfadf49 could not be found. Sep 20 22:29:04.469595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:04.471685 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-dd2274b6-5f77-42eb-8dd3-722c25d4e8c0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Returning 404 to user: Instance bfc70c4c-17f0-432f-a168-0e8a0cfadf49 could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:29:04.471685 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-dd2274b6-5f77-42eb-8dd3-722c25d4e8c0 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49" status: 404 len: 111 microversion: 2.1 time: 0.029505 Sep 20 22:29:04.471685 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 325/675] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:04 2022] GET /compute/v2.1/servers/bfc70c4c-17f0-432f-a168-0e8a0cfadf49 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:29:04.476163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5b63d84b-80ff-40f5-b7cd-bbc065ee65d5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:04.476669 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5b63d84b-80ff-40f5-b7cd-bbc065ee65d5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:04.482673 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5b63d84b-80ff-40f5-b7cd-bbc065ee65d5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:04.483155 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5b63d84b-80ff-40f5-b7cd-bbc065ee65d5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:04.483591 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5b63d84b-80ff-40f5-b7cd-bbc065ee65d5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:04.484279 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5b63d84b-80ff-40f5-b7cd-bbc065ee65d5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:04.484734 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5b63d84b-80ff-40f5-b7cd-bbc065ee65d5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:04.485186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5b63d84b-80ff-40f5-b7cd-bbc065ee65d5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:04.510181 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5b63d84b-80ff-40f5-b7cd-bbc065ee65d5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Going to try to terminate instance {{(pid=120474) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:29:04.584380 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5b63d84b-80ff-40f5-b7cd-bbc065ee65d5 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 204 len: 0 microversion: 2.1 time: 0.111794 Sep 20 22:29:04.585075 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 351/676] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:29:04 2022] DELETE /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:29:04.592905 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-5a6366ca-3b4f-4cc6-8ac0-094e23a6ea5f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:04.593561 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-5a6366ca-3b4f-4cc6-8ac0-094e23a6ea5f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:04.600184 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5a6366ca-3b4f-4cc6-8ac0-094e23a6ea5f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:04.600656 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5a6366ca-3b4f-4cc6-8ac0-094e23a6ea5f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:04.601119 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5a6366ca-3b4f-4cc6-8ac0-094e23a6ea5f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:04.601797 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5a6366ca-3b4f-4cc6-8ac0-094e23a6ea5f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:04.602243 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5a6366ca-3b4f-4cc6-8ac0-094e23a6ea5f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:04.602657 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5a6366ca-3b4f-4cc6-8ac0-094e23a6ea5f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:04.734945 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-5a6366ca-3b4f-4cc6-8ac0-094e23a6ea5f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:04.742811 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-5a6366ca-3b4f-4cc6-8ac0-094e23a6ea5f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.153726 Sep 20 22:29:04.743410 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 326/677] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:04 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:04.774827 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-8411eba2-d1e6-42e3-bf1d-61bf4ddbb355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:04.775562 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-8411eba2-d1e6-42e3-bf1d-61bf4ddbb355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:04.785006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8411eba2-d1e6-42e3-bf1d-61bf4ddbb355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:04.785520 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8411eba2-d1e6-42e3-bf1d-61bf4ddbb355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:04.785964 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8411eba2-d1e6-42e3-bf1d-61bf4ddbb355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:04.786673 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8411eba2-d1e6-42e3-bf1d-61bf4ddbb355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:04.787173 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8411eba2-d1e6-42e3-bf1d-61bf4ddbb355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:04.787658 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8411eba2-d1e6-42e3-bf1d-61bf4ddbb355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:04.920220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-8411eba2-d1e6-42e3-bf1d-61bf4ddbb355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:04.928025 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-8411eba2-d1e6-42e3-bf1d-61bf4ddbb355 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1576 microversion: 2.1 time: 0.157465 Sep 20 22:29:04.928599 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 352/678] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:04 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:05.764952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c1381692-9e49-4e5b-8701-989761a6c6ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:05.765589 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c1381692-9e49-4e5b-8701-989761a6c6ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:05.771956 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c1381692-9e49-4e5b-8701-989761a6c6ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:05.772590 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c1381692-9e49-4e5b-8701-989761a6c6ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:05.772933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c1381692-9e49-4e5b-8701-989761a6c6ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:05.773725 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c1381692-9e49-4e5b-8701-989761a6c6ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:05.774226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c1381692-9e49-4e5b-8701-989761a6c6ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:05.774642 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c1381692-9e49-4e5b-8701-989761a6c6ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:05.901839 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c1381692-9e49-4e5b-8701-989761a6c6ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:05.909887 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-c1381692-9e49-4e5b-8701-989761a6c6ad tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.148842 Sep 20 22:29:05.910449 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 327/679] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:05 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:29:05.951569 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a519d63a-f2b6-4074-8b4e-b8c8fd58a9d2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:05.952304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a519d63a-f2b6-4074-8b4e-b8c8fd58a9d2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:05.958913 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a519d63a-f2b6-4074-8b4e-b8c8fd58a9d2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:05.959400 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a519d63a-f2b6-4074-8b4e-b8c8fd58a9d2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:05.959835 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a519d63a-f2b6-4074-8b4e-b8c8fd58a9d2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:05.960524 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a519d63a-f2b6-4074-8b4e-b8c8fd58a9d2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:05.961005 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a519d63a-f2b6-4074-8b4e-b8c8fd58a9d2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:05.961459 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a519d63a-f2b6-4074-8b4e-b8c8fd58a9d2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:06.092394 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a519d63a-f2b6-4074-8b4e-b8c8fd58a9d2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:06.100700 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a519d63a-f2b6-4074-8b4e-b8c8fd58a9d2 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1576 microversion: 2.1 time: 0.153013 Sep 20 22:29:06.101302 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 353/680] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:05 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:06.933684 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-4df57289-6941-4693-aca0-27c872ec95ca tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:06.934304 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-4df57289-6941-4693-aca0-27c872ec95ca tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:06.941265 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4df57289-6941-4693-aca0-27c872ec95ca tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:06.941742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4df57289-6941-4693-aca0-27c872ec95ca tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:06.942170 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4df57289-6941-4693-aca0-27c872ec95ca tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:06.942851 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4df57289-6941-4693-aca0-27c872ec95ca tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:06.943296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4df57289-6941-4693-aca0-27c872ec95ca tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:06.943714 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4df57289-6941-4693-aca0-27c872ec95ca tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:07.068798 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-4df57289-6941-4693-aca0-27c872ec95ca tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:07.076476 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-4df57289-6941-4693-aca0-27c872ec95ca tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.146633 Sep 20 22:29:07.077065 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 328/681] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:06 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:07.123878 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c964887d-7ce1-4396-9662-5d6a927b6058 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:07.124479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-c964887d-7ce1-4396-9662-5d6a927b6058 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:07.131817 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c964887d-7ce1-4396-9662-5d6a927b6058 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:07.132297 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c964887d-7ce1-4396-9662-5d6a927b6058 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:07.132727 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c964887d-7ce1-4396-9662-5d6a927b6058 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:07.133431 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c964887d-7ce1-4396-9662-5d6a927b6058 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:07.133881 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c964887d-7ce1-4396-9662-5d6a927b6058 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:07.134296 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c964887d-7ce1-4396-9662-5d6a927b6058 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:07.261453 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-c964887d-7ce1-4396-9662-5d6a927b6058 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:07.269341 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c964887d-7ce1-4396-9662-5d6a927b6058 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1576 microversion: 2.1 time: 0.149342 Sep 20 22:29:07.269842 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 354/682] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:07 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:08.099289 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8d6a4b20-3fbd-4fee-bd66-a529c0f9a4d7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:08.099907 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8d6a4b20-3fbd-4fee-bd66-a529c0f9a4d7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:08.106615 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8d6a4b20-3fbd-4fee-bd66-a529c0f9a4d7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:08.107110 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8d6a4b20-3fbd-4fee-bd66-a529c0f9a4d7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:08.107552 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8d6a4b20-3fbd-4fee-bd66-a529c0f9a4d7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:08.108346 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8d6a4b20-3fbd-4fee-bd66-a529c0f9a4d7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:08.108802 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8d6a4b20-3fbd-4fee-bd66-a529c0f9a4d7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:08.109258 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8d6a4b20-3fbd-4fee-bd66-a529c0f9a4d7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:08.239534 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-8d6a4b20-3fbd-4fee-bd66-a529c0f9a4d7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:08.247359 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-8d6a4b20-3fbd-4fee-bd66-a529c0f9a4d7 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.152063 Sep 20 22:29:08.247935 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 329/683] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:08 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:29:08.292798 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-be4bb665-3043-492e-8cf0-fa0e3c4eca07 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:08.293374 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-be4bb665-3043-492e-8cf0-fa0e3c4eca07 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:08.300133 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-be4bb665-3043-492e-8cf0-fa0e3c4eca07 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:08.300616 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-be4bb665-3043-492e-8cf0-fa0e3c4eca07 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:08.301081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-be4bb665-3043-492e-8cf0-fa0e3c4eca07 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:08.301767 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-be4bb665-3043-492e-8cf0-fa0e3c4eca07 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:08.302221 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-be4bb665-3043-492e-8cf0-fa0e3c4eca07 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:08.302642 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-be4bb665-3043-492e-8cf0-fa0e3c4eca07 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:08.428489 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-be4bb665-3043-492e-8cf0-fa0e3c4eca07 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:08.436114 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-be4bb665-3043-492e-8cf0-fa0e3c4eca07 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1576 microversion: 2.1 time: 0.147139 Sep 20 22:29:08.436675 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 355/684] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:08 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:09.271907 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a068ec6e-8ee7-4bea-8d18-f4e307b78a6c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:09.272633 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a068ec6e-8ee7-4bea-8d18-f4e307b78a6c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:09.278880 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a068ec6e-8ee7-4bea-8d18-f4e307b78a6c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:09.279457 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a068ec6e-8ee7-4bea-8d18-f4e307b78a6c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:09.279811 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a068ec6e-8ee7-4bea-8d18-f4e307b78a6c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:09.280555 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a068ec6e-8ee7-4bea-8d18-f4e307b78a6c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:09.285924 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a068ec6e-8ee7-4bea-8d18-f4e307b78a6c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:09.286361 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a068ec6e-8ee7-4bea-8d18-f4e307b78a6c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:09.416130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a068ec6e-8ee7-4bea-8d18-f4e307b78a6c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:09.424994 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a068ec6e-8ee7-4bea-8d18-f4e307b78a6c tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.157774 Sep 20 22:29:09.425656 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 330/685] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:09 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:09.461548 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-8b92323b-04ce-42b1-91b7-893fca5182da tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:09.462260 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-8b92323b-04ce-42b1-91b7-893fca5182da tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:09.470821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b92323b-04ce-42b1-91b7-893fca5182da tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:09.471439 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b92323b-04ce-42b1-91b7-893fca5182da tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:09.471989 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b92323b-04ce-42b1-91b7-893fca5182da tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:09.472855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b92323b-04ce-42b1-91b7-893fca5182da tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:09.473433 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b92323b-04ce-42b1-91b7-893fca5182da tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:09.473963 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b92323b-04ce-42b1-91b7-893fca5182da tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:09.612516 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-8b92323b-04ce-42b1-91b7-893fca5182da tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:09.620699 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-8b92323b-04ce-42b1-91b7-893fca5182da tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1576 microversion: 2.1 time: 0.163833 Sep 20 22:29:09.621312 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 356/686] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:09 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:10.450198 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-00580a29-4d8d-4f98-8216-8ee9945a070f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:10.450809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-00580a29-4d8d-4f98-8216-8ee9945a070f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:10.457214 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-00580a29-4d8d-4f98-8216-8ee9945a070f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:10.457698 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-00580a29-4d8d-4f98-8216-8ee9945a070f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:10.458128 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-00580a29-4d8d-4f98-8216-8ee9945a070f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:10.458900 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-00580a29-4d8d-4f98-8216-8ee9945a070f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:10.459640 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-00580a29-4d8d-4f98-8216-8ee9945a070f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:10.460067 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-00580a29-4d8d-4f98-8216-8ee9945a070f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:10.593254 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-00580a29-4d8d-4f98-8216-8ee9945a070f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:10.601466 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-00580a29-4d8d-4f98-8216-8ee9945a070f tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1520 microversion: 2.1 time: 0.155184 Sep 20 22:29:10.602035 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 331/687] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:10 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:10.644860 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ca0f54bf-2a02-4f9f-8265-ba8a2e4e8e7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:10.645498 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ca0f54bf-2a02-4f9f-8265-ba8a2e4e8e7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:10.652031 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ca0f54bf-2a02-4f9f-8265-ba8a2e4e8e7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:10.652546 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ca0f54bf-2a02-4f9f-8265-ba8a2e4e8e7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:10.652992 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ca0f54bf-2a02-4f9f-8265-ba8a2e4e8e7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:10.653695 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ca0f54bf-2a02-4f9f-8265-ba8a2e4e8e7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:10.654146 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ca0f54bf-2a02-4f9f-8265-ba8a2e4e8e7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:10.654568 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ca0f54bf-2a02-4f9f-8265-ba8a2e4e8e7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:10.864253 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ca0f54bf-2a02-4f9f-8265-ba8a2e4e8e7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:10.871843 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:29:10.874900 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ca0f54bf-2a02-4f9f-8265-ba8a2e4e8e7f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1576 microversion: 2.1 time: 0.234440 Sep 20 22:29:10.875677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 357/688] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:10 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:11.250058 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-de09c587-2083-4ba2-865c-6c8dfd7c78d0 req-5e9c7001-3414-48d6-b06b-9e489aeb5bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b72562d-a97c-4822-bb23-f96a857ce91e", "name": "network-vif-deleted", "tag": "2935ce4a-cc6e-475c-a649-2b15aa333949"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:29:11.260209 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-de09c587-2083-4ba2-865c-6c8dfd7c78d0 req-5e9c7001-3414-48d6-b06b-9e489aeb5bb9 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:11.260683 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-de09c587-2083-4ba2-865c-6c8dfd7c78d0 req-5e9c7001-3414-48d6-b06b-9e489aeb5bb9 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:11.261135 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-de09c587-2083-4ba2-865c-6c8dfd7c78d0 req-5e9c7001-3414-48d6-b06b-9e489aeb5bb9 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:11.272630 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-de09c587-2083-4ba2-865c-6c8dfd7c78d0 req-5e9c7001-3414-48d6-b06b-9e489aeb5bb9 service nova] Creating event network-vif-deleted:2935ce4a-cc6e-475c-a649-2b15aa333949 for instance 7b72562d-a97c-4822-bb23-f96a857ce91e on hv-cinder-85827 Sep 20 22:29:11.277724 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-de09c587-2083-4ba2-865c-6c8dfd7c78d0 req-5e9c7001-3414-48d6-b06b-9e489aeb5bb9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090105 Sep 20 22:29:11.278404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 332/689] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:29:11.624481 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-eb9df7a7-c45d-4a42-8f1e-e06f1d6f9941 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:11.625145 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-eb9df7a7-c45d-4a42-8f1e-e06f1d6f9941 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:11.632860 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eb9df7a7-c45d-4a42-8f1e-e06f1d6f9941 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:11.633375 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eb9df7a7-c45d-4a42-8f1e-e06f1d6f9941 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:11.633814 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eb9df7a7-c45d-4a42-8f1e-e06f1d6f9941 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:11.634510 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eb9df7a7-c45d-4a42-8f1e-e06f1d6f9941 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:11.634992 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eb9df7a7-c45d-4a42-8f1e-e06f1d6f9941 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:11.635389 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eb9df7a7-c45d-4a42-8f1e-e06f1d6f9941 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:11.667251 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eb9df7a7-c45d-4a42-8f1e-e06f1d6f9941 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:11.667849 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eb9df7a7-c45d-4a42-8f1e-e06f1d6f9941 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:11.668079 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eb9df7a7-c45d-4a42-8f1e-e06f1d6f9941 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:11.668536 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-eb9df7a7-c45d-4a42-8f1e-e06f1d6f9941 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lazy-loading 'fault' on Instance uuid 7b72562d-a97c-4822-bb23-f96a857ce91e {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:29:11.712809 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-eb9df7a7-c45d-4a42-8f1e-e06f1d6f9941 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ab0d396ace494c8884d21d41a04e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1076a54706448038779945f53703345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:11.721455 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-eb9df7a7-c45d-4a42-8f1e-e06f1d6f9941 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 200 len: 1311 microversion: 2.1 time: 0.100667 Sep 20 22:29:11.722067 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 358/690] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:11 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:11.898930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-e4202334-11ba-451d-aa9c-2b2552ccfdc4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:11.899636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-e4202334-11ba-451d-aa9c-2b2552ccfdc4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:11.905762 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e4202334-11ba-451d-aa9c-2b2552ccfdc4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:11.906269 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e4202334-11ba-451d-aa9c-2b2552ccfdc4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:11.906727 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e4202334-11ba-451d-aa9c-2b2552ccfdc4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:11.907472 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e4202334-11ba-451d-aa9c-2b2552ccfdc4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:11.907931 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e4202334-11ba-451d-aa9c-2b2552ccfdc4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:11.908843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e4202334-11ba-451d-aa9c-2b2552ccfdc4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:12.037800 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-e4202334-11ba-451d-aa9c-2b2552ccfdc4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:12.045635 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-e4202334-11ba-451d-aa9c-2b2552ccfdc4 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1576 microversion: 2.1 time: 0.151407 Sep 20 22:29:12.046217 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 333/691] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:11 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:12.746951 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-408674e3-77c5-4e07-94ef-1eb087e7cc09 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:12.747653 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-408674e3-77c5-4e07-94ef-1eb087e7cc09 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] [instance: 7b72562d-a97c-4822-bb23-f96a857ce91e] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:12.758964 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-408674e3-77c5-4e07-94ef-1eb087e7cc09 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:12.759447 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-408674e3-77c5-4e07-94ef-1eb087e7cc09 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:12.759915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-408674e3-77c5-4e07-94ef-1eb087e7cc09 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:12.760689 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-408674e3-77c5-4e07-94ef-1eb087e7cc09 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:12.761188 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-408674e3-77c5-4e07-94ef-1eb087e7cc09 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:12.761611 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-408674e3-77c5-4e07-94ef-1eb087e7cc09 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:12.775775 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-408674e3-77c5-4e07-94ef-1eb087e7cc09 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] HTTP exception thrown: Instance 7b72562d-a97c-4822-bb23-f96a857ce91e could not be found. Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-408674e3-77c5-4e07-94ef-1eb087e7cc09 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Request method failure captured: Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e HTTP/1.1 Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj121zgLwFJmRdY8P7mlmZ0v-f9HObvaDYJxym52l22Y024SfHGWFrqhydZ0ZORQZ7-32KLCyqBkv_IlwCXlVT0i8YM1I13VcrEKJTKuP6ul-aOq7DYohb9IE3g2mh3VHvoeTrM31ytaLizPn4LX9RAhk2JxUd9tYcXBoVxsD6N2zWY Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: e1076a54706448038779945f53703345 Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-475540964 Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:29:12.777491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:29:12.779039 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e1076a54706448038779945f53703345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e1076a54706448038779945f53703345", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e1076a54706448038779945f53703345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e1076a54706448038779945f53703345"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:29:12.779039 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-ServerRescueNegativeTestJSON-475540964 Sep 20 22:29:12.779039 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: e1076a54706448038779945f53703345 Sep 20 22:29:12.779039 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-475540964 Sep 20 22:29:12.779039 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-ServerRescueNegativeTestJSON-475540964-project Sep 20 22:29:12.779039 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:29:12.779039 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:29:12.779039 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 55ab0d396ace494c8884d21d41a04e72 Sep 20 22:29:12.779039 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-ServerRescueNegativeTestJSON-475540964-project Sep 20 22:29:12.779039 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:29:12.779039 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance 7b72562d-a97c-4822-bb23-f96a857ce91e could not be found. Sep 20 22:29:12.779039 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': '7b72562d-a97c-4822-bb23-f96a857ce91e'} Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b72562d-a97c-4822-bb23-f96a857ce91e could not be found. Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:29:12.779836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:29:12.781304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:29:12.781304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:29:12.781304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:29:12.781304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:29:12.781304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:29:12.781304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:29:12.781304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:29:12.781304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b72562d-a97c-4822-bb23-f96a857ce91e could not be found. Sep 20 22:29:12.781304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:29:12.781304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:29:12.781304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:29:12.781304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:12.781304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:29:12.781304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:29:12.781304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:29:12.781304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:29:12.781304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b72562d-a97c-4822-bb23-f96a857ce91e could not be found. Sep 20 22:29:12.781304 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:29:12.782638 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-408674e3-77c5-4e07-94ef-1eb087e7cc09 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] Returning 404 to user: Instance 7b72562d-a97c-4822-bb23-f96a857ce91e could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:29:12.782638 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-408674e3-77c5-4e07-94ef-1eb087e7cc09 tempest-ServerRescueNegativeTestJSON-475540964 tempest-ServerRescueNegativeTestJSON-475540964-project] 10.222.0.16 "GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e" status: 404 len: 111 microversion: 2.1 time: 0.036594 Sep 20 22:29:12.782638 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 359/692] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:12 2022] GET /compute/v2.1/servers/7b72562d-a97c-4822-bb23-f96a857ce91e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:29:13.069962 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-40241b32-5e5c-40e4-8a95-6d7b9fdd3353 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:13.070586 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-40241b32-5e5c-40e4-8a95-6d7b9fdd3353 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:13.077140 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-40241b32-5e5c-40e4-8a95-6d7b9fdd3353 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:13.077631 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-40241b32-5e5c-40e4-8a95-6d7b9fdd3353 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:13.078068 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-40241b32-5e5c-40e4-8a95-6d7b9fdd3353 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:13.078760 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-40241b32-5e5c-40e4-8a95-6d7b9fdd3353 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:13.079210 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-40241b32-5e5c-40e4-8a95-6d7b9fdd3353 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:13.079664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-40241b32-5e5c-40e4-8a95-6d7b9fdd3353 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:13.223724 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-40241b32-5e5c-40e4-8a95-6d7b9fdd3353 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:13.232183 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-40241b32-5e5c-40e4-8a95-6d7b9fdd3353 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1576 microversion: 2.1 time: 0.166002 Sep 20 22:29:13.233453 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 334/693] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:13 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:14.257752 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-05a8f5a0-4499-4c7b-a134-d57a5935cacd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:14.258473 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-05a8f5a0-4499-4c7b-a134-d57a5935cacd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:14.264935 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-05a8f5a0-4499-4c7b-a134-d57a5935cacd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:14.265451 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-05a8f5a0-4499-4c7b-a134-d57a5935cacd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:14.265885 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-05a8f5a0-4499-4c7b-a134-d57a5935cacd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:14.266575 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-05a8f5a0-4499-4c7b-a134-d57a5935cacd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:14.267027 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-05a8f5a0-4499-4c7b-a134-d57a5935cacd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:14.267446 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-05a8f5a0-4499-4c7b-a134-d57a5935cacd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:14.473280 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-05a8f5a0-4499-4c7b-a134-d57a5935cacd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:14.481042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-05a8f5a0-4499-4c7b-a134-d57a5935cacd tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1576 microversion: 2.1 time: 0.227137 Sep 20 22:29:14.481621 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 360/694] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:14 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:15.511287 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6d6ad8e2-c56b-4029-a355-c0a094bba291 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:15.512632 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-6d6ad8e2-c56b-4029-a355-c0a094bba291 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:15.520859 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6d6ad8e2-c56b-4029-a355-c0a094bba291 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:15.521654 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6d6ad8e2-c56b-4029-a355-c0a094bba291 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:15.522093 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6d6ad8e2-c56b-4029-a355-c0a094bba291 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:15.522799 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6d6ad8e2-c56b-4029-a355-c0a094bba291 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:15.523255 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6d6ad8e2-c56b-4029-a355-c0a094bba291 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:15.523870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6d6ad8e2-c56b-4029-a355-c0a094bba291 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:15.656613 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-1332be51-e85a-46ab-80a1-0b4613458d67 req-0d1836c8-acae-4a36-88c9-af7fd229bb76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a507bbd4-a0a2-4ca8-b04a-1511797060be", "name": "network-vif-plugged", "status": "completed", "tag": "87454e86-c277-4775-8223-737852068e10"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:29:15.667699 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-1332be51-e85a-46ab-80a1-0b4613458d67 req-0d1836c8-acae-4a36-88c9-af7fd229bb76 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:15.668266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-1332be51-e85a-46ab-80a1-0b4613458d67 req-0d1836c8-acae-4a36-88c9-af7fd229bb76 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:15.668769 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-1332be51-e85a-46ab-80a1-0b4613458d67 req-0d1836c8-acae-4a36-88c9-af7fd229bb76 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:15.686105 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-1332be51-e85a-46ab-80a1-0b4613458d67 req-0d1836c8-acae-4a36-88c9-af7fd229bb76 service nova] Creating event network-vif-plugged:87454e86-c277-4775-8223-737852068e10 for instance a507bbd4-a0a2-4ca8-b04a-1511797060be on hv-cinder-85827 Sep 20 22:29:15.692065 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-1332be51-e85a-46ab-80a1-0b4613458d67 req-0d1836c8-acae-4a36-88c9-af7fd229bb76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039829 Sep 20 22:29:15.693297 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 361/695] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:29:15.783079 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-6d6ad8e2-c56b-4029-a355-c0a094bba291 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:15.791017 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-6d6ad8e2-c56b-4029-a355-c0a094bba291 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1576 microversion: 2.1 time: 0.287498 Sep 20 22:29:15.791690 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 335/696] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:15 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1576 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:16.819367 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-beb0b53d-0b8b-4d3d-b49b-4daa6829f08d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:16.820074 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-beb0b53d-0b8b-4d3d-b49b-4daa6829f08d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:16.827403 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-beb0b53d-0b8b-4d3d-b49b-4daa6829f08d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:16.827886 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-beb0b53d-0b8b-4d3d-b49b-4daa6829f08d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:16.828320 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-beb0b53d-0b8b-4d3d-b49b-4daa6829f08d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:16.829040 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-beb0b53d-0b8b-4d3d-b49b-4daa6829f08d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:16.829495 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-beb0b53d-0b8b-4d3d-b49b-4daa6829f08d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:16.829916 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-beb0b53d-0b8b-4d3d-b49b-4daa6829f08d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:16.967126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-beb0b53d-0b8b-4d3d-b49b-4daa6829f08d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:16.974749 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-beb0b53d-0b8b-4d3d-b49b-4daa6829f08d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1576 microversion: 2.1 time: 0.160364 Sep 20 22:29:16.975322 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 362/697] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:16 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:29:17.999939 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0f0174db-13f4-4590-84c8-49c33c1e72c8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:18.001228 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-0f0174db-13f4-4590-84c8-49c33c1e72c8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:18.008015 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0f0174db-13f4-4590-84c8-49c33c1e72c8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:18.008691 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0f0174db-13f4-4590-84c8-49c33c1e72c8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:18.009000 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0f0174db-13f4-4590-84c8-49c33c1e72c8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:18.010387 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0f0174db-13f4-4590-84c8-49c33c1e72c8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:18.011024 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0f0174db-13f4-4590-84c8-49c33c1e72c8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:18.011669 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0f0174db-13f4-4590-84c8-49c33c1e72c8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:18.193938 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-0f0174db-13f4-4590-84c8-49c33c1e72c8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:18.201659 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-0f0174db-13f4-4590-84c8-49c33c1e72c8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1563 microversion: 2.1 time: 0.207201 Sep 20 22:29:18.202785 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 336/698] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:17 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1563 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:21.402368 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a32dbc1f-bfa4-4cf1-a8bc-67490a3fa394 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:21.403118 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a32dbc1f-bfa4-4cf1-a8bc-67490a3fa394 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:21.405835 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:29:21.412379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a32dbc1f-bfa4-4cf1-a8bc-67490a3fa394 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:21.413016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a32dbc1f-bfa4-4cf1-a8bc-67490a3fa394 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:21.413721 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a32dbc1f-bfa4-4cf1-a8bc-67490a3fa394 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:21.414514 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a32dbc1f-bfa4-4cf1-a8bc-67490a3fa394 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:21.415061 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a32dbc1f-bfa4-4cf1-a8bc-67490a3fa394 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:21.415580 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a32dbc1f-bfa4-4cf1-a8bc-67490a3fa394 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:21.442425 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a32dbc1f-bfa4-4cf1-a8bc-67490a3fa394 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/ips" status: 200 len: 146 microversion: 2.1 time: 0.044198 Sep 20 22:29:21.443961 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 363/699] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 20 22:29:21 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:29:24.115258 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d2030084-9f42-4365-868e-ba6e392a4f2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:24.116479 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d2030084-9f42-4365-868e-ba6e392a4f2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:24.120261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:29:24.124466 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d2030084-9f42-4365-868e-ba6e392a4f2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:24.125147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d2030084-9f42-4365-868e-ba6e392a4f2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:24.125676 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d2030084-9f42-4365-868e-ba6e392a4f2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:24.126602 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d2030084-9f42-4365-868e-ba6e392a4f2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:24.127242 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d2030084-9f42-4365-868e-ba6e392a4f2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:24.127819 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d2030084-9f42-4365-868e-ba6e392a4f2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:24.159906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-d2030084-9f42-4365-868e-ba6e392a4f2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7/ips" status: 200 len: 151 microversion: 2.20 time: 0.443332 Sep 20 22:29:24.160489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 337/700] 10.222.0.16 () {60 vars in 1289 bytes} [Tue Sep 20 22:29:23 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7/ips => generated 151 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:29:25.042967 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-7a1427da-4f04-4e4b-a548-bcf3924166d1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a1d72e5-173c-4855-a406-b13beb9e44ee"}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:29:25.045520 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-7a1427da-4f04-4e4b-a548-bcf3924166d1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:25.056365 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7a1427da-4f04-4e4b-a548-bcf3924166d1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:25.057789 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7a1427da-4f04-4e4b-a548-bcf3924166d1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:25.058715 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7a1427da-4f04-4e4b-a548-bcf3924166d1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:25.060138 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7a1427da-4f04-4e4b-a548-bcf3924166d1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:25.060607 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7a1427da-4f04-4e4b-a548-bcf3924166d1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:25.061263 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7a1427da-4f04-4e4b-a548-bcf3924166d1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:25.364188 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-7a1427da-4f04-4e4b-a548-bcf3924166d1 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "POST /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324838 Sep 20 22:29:25.371295 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 364/701] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 20 22:29:25 2022] POST /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:29:26.300023 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-1525cb91-9d28-43a6-a6ac-e485d3c88f94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:29:26.301607 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-1525cb91-9d28-43a6-a6ac-e485d3c88f94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:26.311962 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1525cb91-9d28-43a6-a6ac-e485d3c88f94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:26.312661 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1525cb91-9d28-43a6-a6ac-e485d3c88f94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:26.313135 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1525cb91-9d28-43a6-a6ac-e485d3c88f94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:26.313848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1525cb91-9d28-43a6-a6ac-e485d3c88f94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:26.314401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1525cb91-9d28-43a6-a6ac-e485d3c88f94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:26.314760 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1525cb91-9d28-43a6-a6ac-e485d3c88f94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:26.318775 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:29:26.342903 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-1525cb91-9d28-43a6-a6ac-e485d3c88f94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lazy-loading 'flavor' on Instance uuid 822d0d2c-d682-4143-b1b3-7feeaf3636f7 {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:29:26.655138 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-1525cb91-9d28-43a6-a6ac-e485d3c88f94 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "POST /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7/action" status: 202 len: 0 microversion: 2.20 time: 0.363286 Sep 20 22:29:26.657637 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 338/702] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Sep 20 22:29:26 2022] POST /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:29:26.668694 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3f4a6c43-73a1-4078-9b7c-534a68914645 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:26.669831 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-3f4a6c43-73a1-4078-9b7c-534a68914645 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:26.685535 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3f4a6c43-73a1-4078-9b7c-534a68914645 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:26.686029 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3f4a6c43-73a1-4078-9b7c-534a68914645 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:26.693737 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3f4a6c43-73a1-4078-9b7c-534a68914645 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:26.698564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3f4a6c43-73a1-4078-9b7c-534a68914645 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:26.702471 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3f4a6c43-73a1-4078-9b7c-534a68914645 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:26.703623 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3f4a6c43-73a1-4078-9b7c-534a68914645 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:26.935977 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3f4a6c43-73a1-4078-9b7c-534a68914645 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:26.949770 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3f4a6c43-73a1-4078-9b7c-534a68914645 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:26.952768 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3f4a6c43-73a1-4078-9b7c-534a68914645 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:26.954033 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-3f4a6c43-73a1-4078-9b7c-534a68914645 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.290339 Sep 20 22:29:26.969175 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 365/703] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:26 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:27.983213 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-38ddd000-4bd4-4a76-af14-2a61689ea5f0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:27.984448 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-38ddd000-4bd4-4a76-af14-2a61689ea5f0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:28.001604 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-38ddd000-4bd4-4a76-af14-2a61689ea5f0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:28.006898 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-38ddd000-4bd4-4a76-af14-2a61689ea5f0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:28.007356 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-38ddd000-4bd4-4a76-af14-2a61689ea5f0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:28.008456 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-38ddd000-4bd4-4a76-af14-2a61689ea5f0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:28.009054 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-38ddd000-4bd4-4a76-af14-2a61689ea5f0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:28.012300 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-38ddd000-4bd4-4a76-af14-2a61689ea5f0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:28.301585 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-38ddd000-4bd4-4a76-af14-2a61689ea5f0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:28.311721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-38ddd000-4bd4-4a76-af14-2a61689ea5f0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:28.318765 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-38ddd000-4bd4-4a76-af14-2a61689ea5f0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:28.321012 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-38ddd000-4bd4-4a76-af14-2a61689ea5f0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.344718 Sep 20 22:29:28.326108 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 339/704] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:27 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:29.353043 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b7844527-2f23-4fa9-ba6c-fc8b430ad894 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:29.354774 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b7844527-2f23-4fa9-ba6c-fc8b430ad894 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:29.362513 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b7844527-2f23-4fa9-ba6c-fc8b430ad894 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:29.363108 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b7844527-2f23-4fa9-ba6c-fc8b430ad894 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:29.363628 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b7844527-2f23-4fa9-ba6c-fc8b430ad894 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:29.364439 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b7844527-2f23-4fa9-ba6c-fc8b430ad894 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:29.365013 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b7844527-2f23-4fa9-ba6c-fc8b430ad894 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:29.365540 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b7844527-2f23-4fa9-ba6c-fc8b430ad894 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:29.596957 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b7844527-2f23-4fa9-ba6c-fc8b430ad894 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:29.606393 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b7844527-2f23-4fa9-ba6c-fc8b430ad894 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:29.606991 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-aab920c3-9929-4d36-81c7-98bd197baa38 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Action: 'create', calling method: .version_select at 0x7f24f68d1280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-262726890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdgMhW7yFmybaaHpQr27+N4Ud/UBc9G/VtAKRyRwep8AmweZ9UrueMfFOzNu3HUk084A54ii2KxPi4yXtE9Xw6jh/pYCUVCqDorXgD+7H3BAwqD9asMLKVyob7ytbX5RA=="}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:29:29.608795 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b7844527-2f23-4fa9-ba6c-fc8b430ad894 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:29.610759 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b7844527-2f23-4fa9-ba6c-fc8b430ad894 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.262876 Sep 20 22:29:29.611587 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 340/705] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:29 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:29.626828 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-aab920c3-9929-4d36-81c7-98bd197baa38 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Getting quotas for project 42019663de764ee490940ccca9300b0f. Resources: {'key_pairs'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:29:29.631266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-aab920c3-9929-4d36-81c7-98bd197baa38 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Getting quotas for user b1b69806fd5f4885a824a58fa1d4432c and project 42019663de764ee490940ccca9300b0f. Resources: {'key_pairs'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:29:29.664288 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-aab920c3-9929-4d36-81c7-98bd197baa38 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.383523 Sep 20 22:29:29.666203 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 366/706] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 20 22:29:29 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:29:30.639345 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-be7ef8e8-550e-4d01-995f-6584276998c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:30.640172 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-be7ef8e8-550e-4d01-995f-6584276998c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:30.651682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-be7ef8e8-550e-4d01-995f-6584276998c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:30.652513 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-be7ef8e8-550e-4d01-995f-6584276998c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:30.653247 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-be7ef8e8-550e-4d01-995f-6584276998c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:30.654274 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-be7ef8e8-550e-4d01-995f-6584276998c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:30.654951 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-be7ef8e8-550e-4d01-995f-6584276998c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:30.656023 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-be7ef8e8-550e-4d01-995f-6584276998c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:30.844441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-be7ef8e8-550e-4d01-995f-6584276998c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:30.857395 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-be7ef8e8-550e-4d01-995f-6584276998c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:30.859372 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-be7ef8e8-550e-4d01-995f-6584276998c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:30.860586 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-be7ef8e8-550e-4d01-995f-6584276998c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.225868 Sep 20 22:29:30.877631 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 341/707] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:30 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:31.904041 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-0e911875-137b-4540-984b-c2be3dcc63d1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:31.904654 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-0e911875-137b-4540-984b-c2be3dcc63d1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:31.916674 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0e911875-137b-4540-984b-c2be3dcc63d1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:31.917299 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0e911875-137b-4540-984b-c2be3dcc63d1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:31.917806 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0e911875-137b-4540-984b-c2be3dcc63d1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:31.918762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0e911875-137b-4540-984b-c2be3dcc63d1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:31.919580 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0e911875-137b-4540-984b-c2be3dcc63d1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:31.920471 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0e911875-137b-4540-984b-c2be3dcc63d1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:32.177570 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-0e911875-137b-4540-984b-c2be3dcc63d1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:32.180912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-89175a0c-0db3-43a4-95c9-2ad77ff106b9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:32.184816 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-89175a0c-0db3-43a4-95c9-2ad77ff106b9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:32.188802 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-0e911875-137b-4540-984b-c2be3dcc63d1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:32.191551 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-89175a0c-0db3-43a4-95c9-2ad77ff106b9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:32.192681 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-89175a0c-0db3-43a4-95c9-2ad77ff106b9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:32.193321 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-0e911875-137b-4540-984b-c2be3dcc63d1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:32.193488 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-89175a0c-0db3-43a4-95c9-2ad77ff106b9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:32.194017 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-89175a0c-0db3-43a4-95c9-2ad77ff106b9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:32.194535 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-0e911875-137b-4540-984b-c2be3dcc63d1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.301322 Sep 20 22:29:32.194797 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-89175a0c-0db3-43a4-95c9-2ad77ff106b9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:32.196662 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 367/708] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:31 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:29:32.200853 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-89175a0c-0db3-43a4-95c9-2ad77ff106b9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:32.239750 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-89175a0c-0db3-43a4-95c9-2ad77ff106b9 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062849 Sep 20 22:29:32.240346 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 342/709] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:29:32 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:29:32.253831 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b9476779-67e1-40be-b561-7ee7f1059aa2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:32.255060 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b9476779-67e1-40be-b561-7ee7f1059aa2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:32.265154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b9476779-67e1-40be-b561-7ee7f1059aa2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:32.266406 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b9476779-67e1-40be-b561-7ee7f1059aa2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:32.267214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b9476779-67e1-40be-b561-7ee7f1059aa2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:32.269908 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b9476779-67e1-40be-b561-7ee7f1059aa2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:32.270668 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b9476779-67e1-40be-b561-7ee7f1059aa2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:32.271634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b9476779-67e1-40be-b561-7ee7f1059aa2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:32.309582 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b9476779-67e1-40be-b561-7ee7f1059aa2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments/0a1d72e5-173c-4855-a406-b13beb9e44ee" status: 200 len: 194 microversion: 2.1 time: 0.061694 Sep 20 22:29:32.329243 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 368/710] 10.222.0.16 () {58 vars in 1413 bytes} [Tue Sep 20 22:29:32 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments/0a1d72e5-173c-4855-a406-b13beb9e44ee => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:29:33.224837 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-158b0a3d-b2dc-4884-bf41-d1d4bb69e1d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:33.225503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-158b0a3d-b2dc-4884-bf41-d1d4bb69e1d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:33.237615 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-158b0a3d-b2dc-4884-bf41-d1d4bb69e1d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:33.238113 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-158b0a3d-b2dc-4884-bf41-d1d4bb69e1d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:33.238557 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-158b0a3d-b2dc-4884-bf41-d1d4bb69e1d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:33.239269 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-158b0a3d-b2dc-4884-bf41-d1d4bb69e1d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:33.243243 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-158b0a3d-b2dc-4884-bf41-d1d4bb69e1d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:33.244024 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-158b0a3d-b2dc-4884-bf41-d1d4bb69e1d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:33.417919 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-158b0a3d-b2dc-4884-bf41-d1d4bb69e1d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:33.432890 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-158b0a3d-b2dc-4884-bf41-d1d4bb69e1d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:33.434409 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-158b0a3d-b2dc-4884-bf41-d1d4bb69e1d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:33.435730 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-158b0a3d-b2dc-4884-bf41-d1d4bb69e1d8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.216647 Sep 20 22:29:33.436584 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 343/711] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:33 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:33.757241 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b246aef3-2c80-479d-85ec-3f8982e6eeb7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2e5a736-0f7b-460d-ab50-56880662727e"}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:29:33.761797 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b246aef3-2c80-479d-85ec-3f8982e6eeb7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:33.769191 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b246aef3-2c80-479d-85ec-3f8982e6eeb7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:33.770032 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b246aef3-2c80-479d-85ec-3f8982e6eeb7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:33.771234 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b246aef3-2c80-479d-85ec-3f8982e6eeb7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:33.772161 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b246aef3-2c80-479d-85ec-3f8982e6eeb7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:33.772823 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b246aef3-2c80-479d-85ec-3f8982e6eeb7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:33.773462 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b246aef3-2c80-479d-85ec-3f8982e6eeb7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:34.097458 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b246aef3-2c80-479d-85ec-3f8982e6eeb7 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "POST /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344125 Sep 20 22:29:34.098224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 369/712] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 20 22:29:33 2022] POST /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:29:34.464769 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-72794b26-8bf5-458e-9831-6dca5f082df7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:34.465970 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-72794b26-8bf5-458e-9831-6dca5f082df7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:34.473050 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-72794b26-8bf5-458e-9831-6dca5f082df7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:34.473773 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-72794b26-8bf5-458e-9831-6dca5f082df7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:34.474402 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-72794b26-8bf5-458e-9831-6dca5f082df7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:34.475174 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-72794b26-8bf5-458e-9831-6dca5f082df7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:34.475630 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-72794b26-8bf5-458e-9831-6dca5f082df7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:34.476058 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-72794b26-8bf5-458e-9831-6dca5f082df7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:34.616746 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-72794b26-8bf5-458e-9831-6dca5f082df7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:34.627232 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-72794b26-8bf5-458e-9831-6dca5f082df7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:34.628811 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-72794b26-8bf5-458e-9831-6dca5f082df7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:34.630100 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-72794b26-8bf5-458e-9831-6dca5f082df7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.170502 Sep 20 22:29:34.631194 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 344/713] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:34 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:35.658479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a286919f-56ad-45e2-9882-0b5058e210e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:35.659272 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a286919f-56ad-45e2-9882-0b5058e210e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:35.666647 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a286919f-56ad-45e2-9882-0b5058e210e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:35.667126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a286919f-56ad-45e2-9882-0b5058e210e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:35.667556 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a286919f-56ad-45e2-9882-0b5058e210e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:35.668274 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a286919f-56ad-45e2-9882-0b5058e210e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:35.668719 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a286919f-56ad-45e2-9882-0b5058e210e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:35.669162 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a286919f-56ad-45e2-9882-0b5058e210e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:35.831877 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a286919f-56ad-45e2-9882-0b5058e210e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:35.840417 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a286919f-56ad-45e2-9882-0b5058e210e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:35.841893 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a286919f-56ad-45e2-9882-0b5058e210e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:35.843038 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a286919f-56ad-45e2-9882-0b5058e210e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.189088 Sep 20 22:29:35.843591 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 370/714] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:35 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:36.875254 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-bb78bcac-be9a-4e2a-b20d-8e0a0249de61 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:36.876541 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-bb78bcac-be9a-4e2a-b20d-8e0a0249de61 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:36.884148 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bb78bcac-be9a-4e2a-b20d-8e0a0249de61 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:36.884728 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bb78bcac-be9a-4e2a-b20d-8e0a0249de61 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:36.885259 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bb78bcac-be9a-4e2a-b20d-8e0a0249de61 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:36.886040 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bb78bcac-be9a-4e2a-b20d-8e0a0249de61 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:36.886565 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bb78bcac-be9a-4e2a-b20d-8e0a0249de61 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:36.887059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bb78bcac-be9a-4e2a-b20d-8e0a0249de61 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:37.027056 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-bb78bcac-be9a-4e2a-b20d-8e0a0249de61 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:37.036411 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-bb78bcac-be9a-4e2a-b20d-8e0a0249de61 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:37.037912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-bb78bcac-be9a-4e2a-b20d-8e0a0249de61 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:37.039077 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-bb78bcac-be9a-4e2a-b20d-8e0a0249de61 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.172815 Sep 20 22:29:37.039632 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 345/715] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:36 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:38.065430 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-35ace9da-7854-4f0b-a689-79d0575d42f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:38.066259 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-35ace9da-7854-4f0b-a689-79d0575d42f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:38.074275 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-35ace9da-7854-4f0b-a689-79d0575d42f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:38.075210 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-35ace9da-7854-4f0b-a689-79d0575d42f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:38.075758 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-35ace9da-7854-4f0b-a689-79d0575d42f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:38.077160 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-35ace9da-7854-4f0b-a689-79d0575d42f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:38.077646 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-35ace9da-7854-4f0b-a689-79d0575d42f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:38.078283 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-35ace9da-7854-4f0b-a689-79d0575d42f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:38.217134 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-35ace9da-7854-4f0b-a689-79d0575d42f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:38.226517 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-35ace9da-7854-4f0b-a689-79d0575d42f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:38.228144 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-35ace9da-7854-4f0b-a689-79d0575d42f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:38.229329 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-35ace9da-7854-4f0b-a689-79d0575d42f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.168509 Sep 20 22:29:38.229887 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 371/716] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:38 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:39.258850 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-415e7f80-3000-42c5-9dd3-3a97eaf2d3c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:39.260202 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-415e7f80-3000-42c5-9dd3-3a97eaf2d3c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:39.266706 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-415e7f80-3000-42c5-9dd3-3a97eaf2d3c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:39.267225 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-415e7f80-3000-42c5-9dd3-3a97eaf2d3c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:39.267659 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-415e7f80-3000-42c5-9dd3-3a97eaf2d3c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:39.268360 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-415e7f80-3000-42c5-9dd3-3a97eaf2d3c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:39.269023 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-415e7f80-3000-42c5-9dd3-3a97eaf2d3c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:39.269649 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-415e7f80-3000-42c5-9dd3-3a97eaf2d3c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:39.452041 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-415e7f80-3000-42c5-9dd3-3a97eaf2d3c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:39.461304 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-415e7f80-3000-42c5-9dd3-3a97eaf2d3c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:39.462880 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-415e7f80-3000-42c5-9dd3-3a97eaf2d3c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:39.464152 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-415e7f80-3000-42c5-9dd3-3a97eaf2d3c7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.212332 Sep 20 22:29:39.464862 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 346/717] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:39 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:29:40.490590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-cb5c03e2-5192-44f9-a4aa-a413ae5449e2 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:40.491756 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-cb5c03e2-5192-44f9-a4aa-a413ae5449e2 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:40.495597 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=4 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:29:40.499489 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cb5c03e2-5192-44f9-a4aa-a413ae5449e2 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:40.499975 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cb5c03e2-5192-44f9-a4aa-a413ae5449e2 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:40.500410 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cb5c03e2-5192-44f9-a4aa-a413ae5449e2 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:40.501134 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cb5c03e2-5192-44f9-a4aa-a413ae5449e2 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:40.501748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cb5c03e2-5192-44f9-a4aa-a413ae5449e2 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:40.502176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cb5c03e2-5192-44f9-a4aa-a413ae5449e2 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:40.658782 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-cb5c03e2-5192-44f9-a4aa-a413ae5449e2 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:40.667270 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-cb5c03e2-5192-44f9-a4aa-a413ae5449e2 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:40.668734 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-cb5c03e2-5192-44f9-a4aa-a413ae5449e2 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:40.669941 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-cb5c03e2-5192-44f9-a4aa-a413ae5449e2 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.183920 Sep 20 22:29:40.670496 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 372/718] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:40 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:41.694910 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-69534543-47d5-4256-8d4e-92f9e1fd3e34 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:41.695589 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-69534543-47d5-4256-8d4e-92f9e1fd3e34 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:41.704085 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-69534543-47d5-4256-8d4e-92f9e1fd3e34 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:41.704863 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-0ce399c7-6b66-4668-92ca-1a5eba9f0861 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:41.705380 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-69534543-47d5-4256-8d4e-92f9e1fd3e34 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:41.705699 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-69534543-47d5-4256-8d4e-92f9e1fd3e34 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:41.706771 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-69534543-47d5-4256-8d4e-92f9e1fd3e34 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:41.707738 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-69534543-47d5-4256-8d4e-92f9e1fd3e34 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:41.708282 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-69534543-47d5-4256-8d4e-92f9e1fd3e34 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:41.709749 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-0ce399c7-6b66-4668-92ca-1a5eba9f0861 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:41.717833 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0ce399c7-6b66-4668-92ca-1a5eba9f0861 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:41.718313 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0ce399c7-6b66-4668-92ca-1a5eba9f0861 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:41.718740 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0ce399c7-6b66-4668-92ca-1a5eba9f0861 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:41.719433 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0ce399c7-6b66-4668-92ca-1a5eba9f0861 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:41.719883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0ce399c7-6b66-4668-92ca-1a5eba9f0861 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:41.720812 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0ce399c7-6b66-4668-92ca-1a5eba9f0861 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:41.724472 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:29:41.754375 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-0ce399c7-6b66-4668-92ca-1a5eba9f0861 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054384 Sep 20 22:29:41.754950 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 373/719] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:29:41 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:29:41.844774 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-69534543-47d5-4256-8d4e-92f9e1fd3e34 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:41.853297 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-69534543-47d5-4256-8d4e-92f9e1fd3e34 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:41.854754 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-69534543-47d5-4256-8d4e-92f9e1fd3e34 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:41.855902 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-69534543-47d5-4256-8d4e-92f9e1fd3e34 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.164873 Sep 20 22:29:41.856459 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 347/720] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:41 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:41.893635 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-705e18ff-35c4-4665-baf7-f66f2b9507b2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:41.894126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-705e18ff-35c4-4665-baf7-f66f2b9507b2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:41.899953 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-705e18ff-35c4-4665-baf7-f66f2b9507b2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:41.900432 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-705e18ff-35c4-4665-baf7-f66f2b9507b2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:41.900867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-705e18ff-35c4-4665-baf7-f66f2b9507b2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:41.901573 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-705e18ff-35c4-4665-baf7-f66f2b9507b2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:41.902024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-705e18ff-35c4-4665-baf7-f66f2b9507b2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:41.902444 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-705e18ff-35c4-4665-baf7-f66f2b9507b2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:41.931875 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-705e18ff-35c4-4665-baf7-f66f2b9507b2 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments/0a1d72e5-173c-4855-a406-b13beb9e44ee" status: 200 len: 194 microversion: 2.1 time: 0.042153 Sep 20 22:29:41.932452 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 374/721] 10.222.0.16 () {58 vars in 1413 bytes} [Tue Sep 20 22:29:41 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments/0a1d72e5-173c-4855-a406-b13beb9e44ee => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:29:41.943683 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c0a06680-8686-41bb-97f7-3d198b5520ba tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:41.944256 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c0a06680-8686-41bb-97f7-3d198b5520ba tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:41.950513 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c0a06680-8686-41bb-97f7-3d198b5520ba tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:41.951002 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c0a06680-8686-41bb-97f7-3d198b5520ba tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:41.951435 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c0a06680-8686-41bb-97f7-3d198b5520ba tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:41.952119 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c0a06680-8686-41bb-97f7-3d198b5520ba tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:41.952621 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c0a06680-8686-41bb-97f7-3d198b5520ba tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:41.953068 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c0a06680-8686-41bb-97f7-3d198b5520ba tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:42.036177 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-c0a06680-8686-41bb-97f7-3d198b5520ba tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lazy-loading 'services' on Instance uuid 383da7f3-a48b-45bf-aa96-d3eb43320ed0 {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:29:42.110029 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-c0a06680-8686-41bb-97f7-3d198b5520ba tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "DELETE /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments/0a1d72e5-173c-4855-a406-b13beb9e44ee" status: 202 len: 0 microversion: 2.1 time: 0.170532 Sep 20 22:29:42.113849 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 348/722] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 20 22:29:41 2022] DELETE /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments/0a1d72e5-173c-4855-a406-b13beb9e44ee => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:29:42.885151 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b8760b43-baae-4a97-aca9-841d5bf7dc47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:42.885787 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b8760b43-baae-4a97-aca9-841d5bf7dc47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:42.892674 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8760b43-baae-4a97-aca9-841d5bf7dc47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:42.893201 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8760b43-baae-4a97-aca9-841d5bf7dc47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:42.893639 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8760b43-baae-4a97-aca9-841d5bf7dc47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:42.894325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8760b43-baae-4a97-aca9-841d5bf7dc47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:42.894776 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8760b43-baae-4a97-aca9-841d5bf7dc47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:42.895198 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8760b43-baae-4a97-aca9-841d5bf7dc47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:43.021586 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b8760b43-baae-4a97-aca9-841d5bf7dc47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:43.029912 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b8760b43-baae-4a97-aca9-841d5bf7dc47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:43.031387 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b8760b43-baae-4a97-aca9-841d5bf7dc47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:43.033242 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b8760b43-baae-4a97-aca9-841d5bf7dc47 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.151404 Sep 20 22:29:43.033817 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 375/723] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:42 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:43.247823 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0d781ace-db59-43ad-aed9-cbad5faf8e30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:43.248487 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-0d781ace-db59-43ad-aed9-cbad5faf8e30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:43.255495 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0d781ace-db59-43ad-aed9-cbad5faf8e30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:43.256019 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0d781ace-db59-43ad-aed9-cbad5faf8e30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:43.256526 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0d781ace-db59-43ad-aed9-cbad5faf8e30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:43.257332 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0d781ace-db59-43ad-aed9-cbad5faf8e30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:43.257855 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0d781ace-db59-43ad-aed9-cbad5faf8e30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:43.258289 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0d781ace-db59-43ad-aed9-cbad5faf8e30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:43.287876 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-0d781ace-db59-43ad-aed9-cbad5faf8e30 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments/a2e5a736-0f7b-460d-ab50-56880662727e" status: 200 len: 194 microversion: 2.1 time: 0.044783 Sep 20 22:29:43.289379 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 349/724] 10.222.0.16 () {58 vars in 1413 bytes} [Tue Sep 20 22:29:43 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments/a2e5a736-0f7b-460d-ab50-56880662727e => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:29:43.299247 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-72d3f85e-7090-49ad-9fad-90d8865bff65 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:43.300028 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-72d3f85e-7090-49ad-9fad-90d8865bff65 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:43.306141 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-72d3f85e-7090-49ad-9fad-90d8865bff65 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:43.306680 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-72d3f85e-7090-49ad-9fad-90d8865bff65 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:43.307142 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-72d3f85e-7090-49ad-9fad-90d8865bff65 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:43.307833 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-72d3f85e-7090-49ad-9fad-90d8865bff65 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:43.308313 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-72d3f85e-7090-49ad-9fad-90d8865bff65 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:43.308742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-72d3f85e-7090-49ad-9fad-90d8865bff65 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:43.388298 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-72d3f85e-7090-49ad-9fad-90d8865bff65 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lazy-loading 'services' on Instance uuid 383da7f3-a48b-45bf-aa96-d3eb43320ed0 {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:29:43.461855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-72d3f85e-7090-49ad-9fad-90d8865bff65 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "DELETE /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments/a2e5a736-0f7b-460d-ab50-56880662727e" status: 202 len: 0 microversion: 2.1 time: 0.166333 Sep 20 22:29:43.462646 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 376/725] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 20 22:29:43 2022] DELETE /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments/a2e5a736-0f7b-460d-ab50-56880662727e => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:29:44.058289 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d374c9f6-db2d-4c04-9a0c-b466c8323351 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:44.058898 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d374c9f6-db2d-4c04-9a0c-b466c8323351 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:44.064732 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d374c9f6-db2d-4c04-9a0c-b466c8323351 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:44.065134 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d374c9f6-db2d-4c04-9a0c-b466c8323351 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:44.065586 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d374c9f6-db2d-4c04-9a0c-b466c8323351 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:44.066874 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d374c9f6-db2d-4c04-9a0c-b466c8323351 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:44.067322 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d374c9f6-db2d-4c04-9a0c-b466c8323351 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:44.067740 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d374c9f6-db2d-4c04-9a0c-b466c8323351 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:44.247710 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-d374c9f6-db2d-4c04-9a0c-b466c8323351 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:44.256686 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-d374c9f6-db2d-4c04-9a0c-b466c8323351 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:44.258468 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-d374c9f6-db2d-4c04-9a0c-b466c8323351 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:44.259800 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-d374c9f6-db2d-4c04-9a0c-b466c8323351 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.205509 Sep 20 22:29:44.260605 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 350/726] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:44 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:44.643807 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-59b65ff0-5b9c-4c1c-ab25-632569b8e7d5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:44.646229 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-59b65ff0-5b9c-4c1c-ab25-632569b8e7d5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:44.653293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-59b65ff0-5b9c-4c1c-ab25-632569b8e7d5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:44.653774 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-59b65ff0-5b9c-4c1c-ab25-632569b8e7d5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:44.654208 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-59b65ff0-5b9c-4c1c-ab25-632569b8e7d5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:44.654898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-59b65ff0-5b9c-4c1c-ab25-632569b8e7d5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:44.655350 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-59b65ff0-5b9c-4c1c-ab25-632569b8e7d5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:44.655769 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-59b65ff0-5b9c-4c1c-ab25-632569b8e7d5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:44.685868 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-59b65ff0-5b9c-4c1c-ab25-632569b8e7d5 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047440 Sep 20 22:29:44.686773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 377/727] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:29:44 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 20 22:29:44.830813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-04b37b87-b704-4065-9203-069fca9f2516 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:44.833514 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-04b37b87-b704-4065-9203-069fca9f2516 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:44.840242 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-04b37b87-b704-4065-9203-069fca9f2516 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:44.840930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-04b37b87-b704-4065-9203-069fca9f2516 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:44.841556 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-04b37b87-b704-4065-9203-069fca9f2516 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:44.842422 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-04b37b87-b704-4065-9203-069fca9f2516 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:44.842914 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-04b37b87-b704-4065-9203-069fca9f2516 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:44.843340 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-04b37b87-b704-4065-9203-069fca9f2516 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:44.873255 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-04b37b87-b704-4065-9203-069fca9f2516 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047432 Sep 20 22:29:44.879366 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 351/728] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:29:44 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 20 22:29:44.942480 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-7f6e50dc-54cf-412f-9b85-2e7be2df13c3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:44.942982 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-7f6e50dc-54cf-412f-9b85-2e7be2df13c3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:44.948839 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7f6e50dc-54cf-412f-9b85-2e7be2df13c3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:44.949381 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7f6e50dc-54cf-412f-9b85-2e7be2df13c3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:44.949812 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7f6e50dc-54cf-412f-9b85-2e7be2df13c3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:44.950503 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7f6e50dc-54cf-412f-9b85-2e7be2df13c3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:44.950951 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7f6e50dc-54cf-412f-9b85-2e7be2df13c3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:44.951396 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7f6e50dc-54cf-412f-9b85-2e7be2df13c3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:44.976945 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-7f6e50dc-54cf-412f-9b85-2e7be2df13c3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Going to try to terminate instance {{(pid=120474) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:29:45.093414 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-7f6e50dc-54cf-412f-9b85-2e7be2df13c3 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "DELETE /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 204 len: 0 microversion: 2.1 time: 0.155311 Sep 20 22:29:45.094337 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 378/729] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:29:44 2022] DELETE /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:29:45.102547 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-89d3f503-a5a7-49e5-a0eb-5641bf8d87bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:45.103162 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-89d3f503-a5a7-49e5-a0eb-5641bf8d87bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:45.108909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-89d3f503-a5a7-49e5-a0eb-5641bf8d87bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:45.109422 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-89d3f503-a5a7-49e5-a0eb-5641bf8d87bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:45.109856 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-89d3f503-a5a7-49e5-a0eb-5641bf8d87bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:45.111055 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-89d3f503-a5a7-49e5-a0eb-5641bf8d87bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:45.111510 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-89d3f503-a5a7-49e5-a0eb-5641bf8d87bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:45.111931 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-89d3f503-a5a7-49e5-a0eb-5641bf8d87bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:45.115958 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:29:45.249119 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-89d3f503-a5a7-49e5-a0eb-5641bf8d87bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:45.258014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-89d3f503-a5a7-49e5-a0eb-5641bf8d87bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1673 microversion: 2.1 time: 0.159327 Sep 20 22:29:45.273008 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 352/730] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:45 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:45.288038 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-7f7f3f6f-6037-45fa-a98b-92b4b0431cf7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:45.288691 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-7f7f3f6f-6037-45fa-a98b-92b4b0431cf7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:45.294737 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7f7f3f6f-6037-45fa-a98b-92b4b0431cf7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:45.299988 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7f7f3f6f-6037-45fa-a98b-92b4b0431cf7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:45.299988 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7f7f3f6f-6037-45fa-a98b-92b4b0431cf7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:45.299988 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7f7f3f6f-6037-45fa-a98b-92b4b0431cf7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:45.299988 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7f7f3f6f-6037-45fa-a98b-92b4b0431cf7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:45.300355 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7f7f3f6f-6037-45fa-a98b-92b4b0431cf7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:45.434634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-7f7f3f6f-6037-45fa-a98b-92b4b0431cf7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:45.443311 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-7f7f3f6f-6037-45fa-a98b-92b4b0431cf7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:45.444744 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-7f7f3f6f-6037-45fa-a98b-92b4b0431cf7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:45.445934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-7f7f3f6f-6037-45fa-a98b-92b4b0431cf7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.162223 Sep 20 22:29:45.446492 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 379/731] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:45 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:46.280506 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a08b3b0c-359d-4802-812f-55868bd41530 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:46.281157 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a08b3b0c-359d-4802-812f-55868bd41530 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:46.287442 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a08b3b0c-359d-4802-812f-55868bd41530 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:46.287922 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a08b3b0c-359d-4802-812f-55868bd41530 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:46.288357 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a08b3b0c-359d-4802-812f-55868bd41530 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:46.289063 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a08b3b0c-359d-4802-812f-55868bd41530 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:46.289519 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a08b3b0c-359d-4802-812f-55868bd41530 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:46.289936 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a08b3b0c-359d-4802-812f-55868bd41530 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:46.474120 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-133ecde8-d607-4c31-bfae-ba5b3d4e9bb4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:46.475485 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-133ecde8-d607-4c31-bfae-ba5b3d4e9bb4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:46.482537 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-133ecde8-d607-4c31-bfae-ba5b3d4e9bb4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:46.483286 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-133ecde8-d607-4c31-bfae-ba5b3d4e9bb4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:46.483920 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-133ecde8-d607-4c31-bfae-ba5b3d4e9bb4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:46.484883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-133ecde8-d607-4c31-bfae-ba5b3d4e9bb4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:46.485640 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-133ecde8-d607-4c31-bfae-ba5b3d4e9bb4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:46.486424 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-133ecde8-d607-4c31-bfae-ba5b3d4e9bb4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:46.637726 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-133ecde8-d607-4c31-bfae-ba5b3d4e9bb4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:46.648077 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-133ecde8-d607-4c31-bfae-ba5b3d4e9bb4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:46.649921 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-133ecde8-d607-4c31-bfae-ba5b3d4e9bb4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:46.651359 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-133ecde8-d607-4c31-bfae-ba5b3d4e9bb4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.181299 Sep 20 22:29:46.652031 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 380/732] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:46 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:29:46.694653 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a08b3b0c-359d-4802-812f-55868bd41530 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:46.702806 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a08b3b0c-359d-4802-812f-55868bd41530 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1673 microversion: 2.1 time: 0.426085 Sep 20 22:29:46.703682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 353/733] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:46 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1673 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:47.630501 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5335c8ab-d31e-4282-857a-4f433947b74f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-965876637", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-262726890", "security_groups": [{"name": "tempest-secgroup-smoke-2073120544"}], "block_device_mapping_v2": [{"uuid": "94de95c3-9489-4551-93f1-1daab600e698", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "da8aba85-9a54-4a6e-abea-b06fe770c5b2"}]}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:29:47.677675 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-dd1f72ad-3b75-4a18-ac87-532acd70a9e9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:47.678287 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-dd1f72ad-3b75-4a18-ac87-532acd70a9e9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:47.684642 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dd1f72ad-3b75-4a18-ac87-532acd70a9e9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:47.685268 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dd1f72ad-3b75-4a18-ac87-532acd70a9e9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:47.685905 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dd1f72ad-3b75-4a18-ac87-532acd70a9e9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:47.686597 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dd1f72ad-3b75-4a18-ac87-532acd70a9e9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:47.687251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dd1f72ad-3b75-4a18-ac87-532acd70a9e9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:47.687671 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dd1f72ad-3b75-4a18-ac87-532acd70a9e9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:47.805467 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.network.neutron [None req-5335c8ab-d31e-4282-857a-4f433947b74f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] validate_networks() for [('da8aba85-9a54-4a6e-abea-b06fe770c5b2', None, None, None, None, None)] {{(pid=120474) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:29:47.817877 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-dd1f72ad-3b75-4a18-ac87-532acd70a9e9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:47.826154 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-dd1f72ad-3b75-4a18-ac87-532acd70a9e9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:47.827677 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-dd1f72ad-3b75-4a18-ac87-532acd70a9e9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:47.828838 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-dd1f72ad-3b75-4a18-ac87-532acd70a9e9 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1744 microversion: 2.20 time: 0.155598 Sep 20 22:29:47.829421 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 354/734] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:47 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:29:47.833898 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-12f7967d-6433-4b3b-9e77-34b4ea1cc3bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:47.834499 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-12f7967d-6433-4b3b-9e77-34b4ea1cc3bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:47.840099 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-12f7967d-6433-4b3b-9e77-34b4ea1cc3bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:47.840761 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-12f7967d-6433-4b3b-9e77-34b4ea1cc3bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:47.841293 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-12f7967d-6433-4b3b-9e77-34b4ea1cc3bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:47.842030 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-12f7967d-6433-4b3b-9e77-34b4ea1cc3bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:47.842484 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-12f7967d-6433-4b3b-9e77-34b4ea1cc3bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:47.842917 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-12f7967d-6433-4b3b-9e77-34b4ea1cc3bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:47.921305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-12f7967d-6433-4b3b-9e77-34b4ea1cc3bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:47.928938 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-12f7967d-6433-4b3b-9e77-34b4ea1cc3bf tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1606 microversion: 2.1 time: 0.098447 Sep 20 22:29:47.929784 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 355/735] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:47 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1606 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:48.392549 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-1ad878cb-e7bb-42e1-821d-a3affebc35ec req-381aa354-996f-43fd-8cd7-afca923a6847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383da7f3-a48b-45bf-aa96-d3eb43320ed0", "name": "network-vif-deleted", "tag": "0cfdba0d-6995-4cd9-a5d7-8cea3b491626"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:29:48.423160 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-1ad878cb-e7bb-42e1-821d-a3affebc35ec req-381aa354-996f-43fd-8cd7-afca923a6847 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:48.424018 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-1ad878cb-e7bb-42e1-821d-a3affebc35ec req-381aa354-996f-43fd-8cd7-afca923a6847 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:48.425175 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-1ad878cb-e7bb-42e1-821d-a3affebc35ec req-381aa354-996f-43fd-8cd7-afca923a6847 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:48.440145 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-1ad878cb-e7bb-42e1-821d-a3affebc35ec req-381aa354-996f-43fd-8cd7-afca923a6847 service nova] Creating event network-vif-deleted:0cfdba0d-6995-4cd9-a5d7-8cea3b491626 for instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 on hv-cinder-85827 Sep 20 22:29:48.445929 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-1ad878cb-e7bb-42e1-821d-a3affebc35ec req-381aa354-996f-43fd-8cd7-afca923a6847 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057334 Sep 20 22:29:48.447177 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 356/736] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:29:48.768692 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-5335c8ab-d31e-4282-857a-4f433947b74f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Flavor limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:29:48.769196 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-5335c8ab-d31e-4282-857a-4f433947b74f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Image limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:29:48.769661 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-5335c8ab-d31e-4282-857a-4f433947b74f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Flavor pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:29:48.770074 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-5335c8ab-d31e-4282-857a-4f433947b74f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Image pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:29:48.770485 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-5335c8ab-d31e-4282-857a-4f433947b74f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:29:48.779324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5335c8ab-d31e-4282-857a-4f433947b74f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:48.779818 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5335c8ab-d31e-4282-857a-4f433947b74f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:48.780313 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5335c8ab-d31e-4282-857a-4f433947b74f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:48.781081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5335c8ab-d31e-4282-857a-4f433947b74f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:48.781541 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5335c8ab-d31e-4282-857a-4f433947b74f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:48.781968 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5335c8ab-d31e-4282-857a-4f433947b74f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:48.799621 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-5335c8ab-d31e-4282-857a-4f433947b74f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Getting quotas for project 42019663de764ee490940ccca9300b0f. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:29:48.803641 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-5335c8ab-d31e-4282-857a-4f433947b74f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Getting quotas for user b1b69806fd5f4885a824a58fa1d4432c and project 42019663de764ee490940ccca9300b0f. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:29:48.857619 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-f55e7566-41fe-4d4e-83d3-04c414474107 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:48.858773 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-f55e7566-41fe-4d4e-83d3-04c414474107 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:48.863097 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5335c8ab-d31e-4282-857a-4f433947b74f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Going to run 1 instances... {{(pid=120474) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:29:48.866976 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5335c8ab-d31e-4282-857a-4f433947b74f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='94de95c3-9489-4551-93f1-1daab600e698',volume_size=None,volume_type=None)] {{(pid=120474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:29:48.877087 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f55e7566-41fe-4d4e-83d3-04c414474107 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:48.877704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f55e7566-41fe-4d4e-83d3-04c414474107 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:48.877995 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f55e7566-41fe-4d4e-83d3-04c414474107 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:48.879271 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f55e7566-41fe-4d4e-83d3-04c414474107 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:48.880025 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f55e7566-41fe-4d4e-83d3-04c414474107 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:48.880454 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f55e7566-41fe-4d4e-83d3-04c414474107 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:49.050146 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5335c8ab-d31e-4282-857a-4f433947b74f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.425769 Sep 20 22:29:49.051562 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f55e7566-41fe-4d4e-83d3-04c414474107 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:49.052473 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 381/737] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:29:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 20 22:29:49.058091 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-18260af0-a4a1-4c94-8b48-be8d15ef9ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:49.059227 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-18260af0-a4a1-4c94-8b48-be8d15ef9ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:49.067068 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f55e7566-41fe-4d4e-83d3-04c414474107 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:49.067611 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-18260af0-a4a1-4c94-8b48-be8d15ef9ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:49.068356 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-18260af0-a4a1-4c94-8b48-be8d15ef9ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:49.068832 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f55e7566-41fe-4d4e-83d3-04c414474107 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:49.069434 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-18260af0-a4a1-4c94-8b48-be8d15ef9ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:49.070218 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-f55e7566-41fe-4d4e-83d3-04c414474107 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1744 microversion: 2.20 time: 0.218127 Sep 20 22:29:49.070587 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-18260af0-a4a1-4c94-8b48-be8d15ef9ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:49.071126 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 357/738] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:48 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1744 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:29:49.071589 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-18260af0-a4a1-4c94-8b48-be8d15ef9ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:49.072265 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-18260af0-a4a1-4c94-8b48-be8d15ef9ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:49.075759 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-e7239aef-4e1a-48d4-9d91-945f39477e3b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:49.076366 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-e7239aef-4e1a-48d4-9d91-945f39477e3b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:49.129837 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-18260af0-a4a1-4c94-8b48-be8d15ef9ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:49.130698 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-18260af0-a4a1-4c94-8b48-be8d15ef9ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:49.131326 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-18260af0-a4a1-4c94-8b48-be8d15ef9ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:49.132134 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-18260af0-a4a1-4c94-8b48-be8d15ef9ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lazy-loading 'fault' on Instance uuid 383da7f3-a48b-45bf-aa96-d3eb43320ed0 {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:29:49.194767 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-e7239aef-4e1a-48d4-9d91-945f39477e3b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:49.195991 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-18260af0-a4a1-4c94-8b48-be8d15ef9ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45fbc2758e641fba97c0b3096db4f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ff885440634a13916a25973bdde7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:49.202373 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-e7239aef-4e1a-48d4-9d91-945f39477e3b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1093 microversion: 2.1 time: 0.129610 Sep 20 22:29:49.203856 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 358/739] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:49 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1093 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:49.210093 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-18260af0-a4a1-4c94-8b48-be8d15ef9ec6 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 200 len: 1327 microversion: 2.1 time: 0.149930 Sep 20 22:29:49.210093 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 382/740] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:49 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 1327 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:50.103574 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-21609738-6476-4f0c-8572-9b58755971c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:50.105131 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-21609738-6476-4f0c-8572-9b58755971c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:50.113215 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-21609738-6476-4f0c-8572-9b58755971c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:50.113769 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-21609738-6476-4f0c-8572-9b58755971c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:50.114229 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-21609738-6476-4f0c-8572-9b58755971c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:50.114907 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-21609738-6476-4f0c-8572-9b58755971c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:50.115410 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-21609738-6476-4f0c-8572-9b58755971c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:50.116000 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-21609738-6476-4f0c-8572-9b58755971c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:50.232136 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6ea6cd06-7f19-4a4c-994b-4ceac35a2717 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:50.233307 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-6ea6cd06-7f19-4a4c-994b-4ceac35a2717 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:50.252819 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6ea6cd06-7f19-4a4c-994b-4ceac35a2717 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:50.254476 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6ea6cd06-7f19-4a4c-994b-4ceac35a2717 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:50.255232 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6ea6cd06-7f19-4a4c-994b-4ceac35a2717 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:50.263095 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6ea6cd06-7f19-4a4c-994b-4ceac35a2717 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:50.264179 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6ea6cd06-7f19-4a4c-994b-4ceac35a2717 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:50.265723 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6ea6cd06-7f19-4a4c-994b-4ceac35a2717 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:50.381675 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-6ea6cd06-7f19-4a4c-994b-4ceac35a2717 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:50.392744 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-6ea6cd06-7f19-4a4c-994b-4ceac35a2717 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1191 microversion: 2.1 time: 0.169107 Sep 20 22:29:50.394024 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 359/741] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:50 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1191 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:29:50.396373 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-21609738-6476-4f0c-8572-9b58755971c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:50.399259 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-63f74e5f-09f8-4859-adf8-2c7ae9afe21d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:50.399870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-63f74e5f-09f8-4859-adf8-2c7ae9afe21d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:50.404781 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-21609738-6476-4f0c-8572-9b58755971c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:50.406427 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-21609738-6476-4f0c-8572-9b58755971c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:50.406828 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-63f74e5f-09f8-4859-adf8-2c7ae9afe21d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:50.408101 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-63f74e5f-09f8-4859-adf8-2c7ae9afe21d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:50.408245 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-21609738-6476-4f0c-8572-9b58755971c6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1739 microversion: 2.20 time: 0.315375 Sep 20 22:29:50.408937 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-63f74e5f-09f8-4859-adf8-2c7ae9afe21d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:50.409813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-63f74e5f-09f8-4859-adf8-2c7ae9afe21d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:50.410408 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-63f74e5f-09f8-4859-adf8-2c7ae9afe21d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:50.410971 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-63f74e5f-09f8-4859-adf8-2c7ae9afe21d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:50.417127 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 383/742] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:50 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1739 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:50.429393 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-63f74e5f-09f8-4859-adf8-2c7ae9afe21d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] HTTP exception thrown: Instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 could not be found. Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-63f74e5f-09f8-4859-adf8-2c7ae9afe21d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Request method failure captured: Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 HTTP/1.1 Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj1u8Dac5LZoF9XvxzObiNZxaRtyHxJ9XJCPxEJUsZxCMmbYYjxZiqp8WdtamDDYfYrpvZPtB49n4OwOY35bDrutB_d1OI-gkcaYsYQhaL96sGaWU4DwbzLXaDsDWtPmcswXjUjTaYb7SdtEenwFZYFQiBG2KmA3RHtaz4ujsgmicSM Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: 02ff885440634a13916a25973bdde7b3 Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-AttachVolumeTestJSON-1455725482 Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:29:50.431478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:29:50.432984 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02ff885440634a13916a25973bdde7b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_02ff885440634a13916a25973bdde7b3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/02ff885440634a13916a25973bdde7b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02ff885440634a13916a25973bdde7b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:29:50.432984 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-AttachVolumeTestJSON-1455725482 Sep 20 22:29:50.432984 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: 02ff885440634a13916a25973bdde7b3 Sep 20 22:29:50.432984 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1455725482 Sep 20 22:29:50.432984 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-AttachVolumeTestJSON-1455725482-project Sep 20 22:29:50.432984 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:29:50.432984 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:29:50.432984 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: c45fbc2758e641fba97c0b3096db4f15 Sep 20 22:29:50.432984 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-AttachVolumeTestJSON-1455725482-project Sep 20 22:29:50.432984 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:29:50.432984 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 could not be found. Sep 20 22:29:50.432984 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': '383da7f3-a48b-45bf-aa96-d3eb43320ed0'} Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 could not be found. Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:29:50.433870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:29:50.435401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:29:50.435401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:29:50.435401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:29:50.435401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:29:50.435401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:29:50.435401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:29:50.435401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:29:50.435401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 could not be found. Sep 20 22:29:50.435401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:50.435401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:29:50.435401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:50.435401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:50.435401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:29:50.435401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:29:50.435401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:29:50.435401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:29:50.435401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 could not be found. Sep 20 22:29:50.435401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:50.440148 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-63f74e5f-09f8-4859-adf8-2c7ae9afe21d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Returning 404 to user: Instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:29:50.441324 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-63f74e5f-09f8-4859-adf8-2c7ae9afe21d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 404 len: 111 microversion: 2.1 time: 0.045989 Sep 20 22:29:50.442123 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 360/743] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:50 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:29:50.452000 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-09f7530d-20c2-4d6a-8074-78a7a6b6f441 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '.version_select at 0x7f24f679c1f0>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:50.482300 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-09f7530d-20c2-4d6a-8074-78a7a6b6f441 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-744753904" status: 202 len: 0 microversion: 2.1 time: 0.035429 Sep 20 22:29:50.487642 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 361/744] 10.222.0.16 () {58 vars in 1218 bytes} [Tue Sep 20 22:29:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-744753904 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 22:29:50.778064 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-38244444-56fe-4d9d-87cd-2bff87aee60c req-db9e41d0-ceb4-465b-944c-0d13aafbea5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822d0d2c-d682-4143-b1b3-7feeaf3636f7", "name": "network-vif-plugged", "status": "completed", "tag": "d76e99ad-dedc-45dd-ba58-8632f5cb0aba"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:29:50.818787 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-38244444-56fe-4d9d-87cd-2bff87aee60c req-db9e41d0-ceb4-465b-944c-0d13aafbea5d service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:50.821762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-38244444-56fe-4d9d-87cd-2bff87aee60c req-db9e41d0-ceb4-465b-944c-0d13aafbea5d service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:50.822212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-38244444-56fe-4d9d-87cd-2bff87aee60c req-db9e41d0-ceb4-465b-944c-0d13aafbea5d service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:50.855256 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-38244444-56fe-4d9d-87cd-2bff87aee60c req-db9e41d0-ceb4-465b-944c-0d13aafbea5d service nova] Creating event network-vif-plugged:d76e99ad-dedc-45dd-ba58-8632f5cb0aba for instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 on hv-cinder-85827 Sep 20 22:29:50.866523 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-38244444-56fe-4d9d-87cd-2bff87aee60c req-db9e41d0-ceb4-465b-944c-0d13aafbea5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.444912 Sep 20 22:29:50.867670 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 384/745] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:29:51.423565 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ac5c7fe6-39b9-465e-9235-164b6719b7bd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:51.423565 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ac5c7fe6-39b9-465e-9235-164b6719b7bd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:51.445951 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-79ee0ae5-a532-48c1-ac1c-b9e4ec17267d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:51.446657 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-79ee0ae5-a532-48c1-ac1c-b9e4ec17267d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:51.461576 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ac5c7fe6-39b9-465e-9235-164b6719b7bd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:51.468474 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:29:51.470041 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ac5c7fe6-39b9-465e-9235-164b6719b7bd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:51.470636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ac5c7fe6-39b9-465e-9235-164b6719b7bd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:51.471397 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ac5c7fe6-39b9-465e-9235-164b6719b7bd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:51.471874 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ac5c7fe6-39b9-465e-9235-164b6719b7bd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:51.473884 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-79ee0ae5-a532-48c1-ac1c-b9e4ec17267d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:51.474241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ac5c7fe6-39b9-465e-9235-164b6719b7bd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:51.474909 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-79ee0ae5-a532-48c1-ac1c-b9e4ec17267d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:51.477008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-79ee0ae5-a532-48c1-ac1c-b9e4ec17267d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:51.480246 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-79ee0ae5-a532-48c1-ac1c-b9e4ec17267d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:51.480891 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-79ee0ae5-a532-48c1-ac1c-b9e4ec17267d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:51.481530 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-79ee0ae5-a532-48c1-ac1c-b9e4ec17267d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:51.616092 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ac5c7fe6-39b9-465e-9235-164b6719b7bd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:51.625584 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ac5c7fe6-39b9-465e-9235-164b6719b7bd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1209 microversion: 2.1 time: 0.209482 Sep 20 22:29:51.630259 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 362/746] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:51 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1209 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:29:51.776461 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-79ee0ae5-a532-48c1-ac1c-b9e4ec17267d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:51.789684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-79ee0ae5-a532-48c1-ac1c-b9e4ec17267d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:51.792643 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-79ee0ae5-a532-48c1-ac1c-b9e4ec17267d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:51.794068 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-79ee0ae5-a532-48c1-ac1c-b9e4ec17267d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1739 microversion: 2.20 time: 0.357852 Sep 20 22:29:51.795159 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 385/747] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:51 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1739 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:52.665954 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a5f790be-c289-4c93-a69d-ef6dc6b6b750 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:52.673901 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a5f790be-c289-4c93-a69d-ef6dc6b6b750 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:52.692947 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a5f790be-c289-4c93-a69d-ef6dc6b6b750 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:52.693750 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a5f790be-c289-4c93-a69d-ef6dc6b6b750 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:52.694481 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a5f790be-c289-4c93-a69d-ef6dc6b6b750 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:52.695544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a5f790be-c289-4c93-a69d-ef6dc6b6b750 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:52.696223 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a5f790be-c289-4c93-a69d-ef6dc6b6b750 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:52.696867 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a5f790be-c289-4c93-a69d-ef6dc6b6b750 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:52.825810 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3801ff13-2d73-4e82-97e6-b994dba6747f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:52.827842 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-3801ff13-2d73-4e82-97e6-b994dba6747f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:52.845657 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3801ff13-2d73-4e82-97e6-b994dba6747f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:52.847510 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3801ff13-2d73-4e82-97e6-b994dba6747f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:52.848753 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3801ff13-2d73-4e82-97e6-b994dba6747f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:52.851034 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3801ff13-2d73-4e82-97e6-b994dba6747f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:52.852385 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3801ff13-2d73-4e82-97e6-b994dba6747f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:52.854473 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3801ff13-2d73-4e82-97e6-b994dba6747f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:53.115789 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3801ff13-2d73-4e82-97e6-b994dba6747f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:53.125388 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3801ff13-2d73-4e82-97e6-b994dba6747f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:53.127081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3801ff13-2d73-4e82-97e6-b994dba6747f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:53.128510 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-3801ff13-2d73-4e82-97e6-b994dba6747f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1739 microversion: 2.20 time: 0.311765 Sep 20 22:29:53.129565 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 386/748] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:52 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1739 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:53.175092 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a5f790be-c289-4c93-a69d-ef6dc6b6b750 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:53.184087 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a5f790be-c289-4c93-a69d-ef6dc6b6b750 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1265 microversion: 2.1 time: 0.534039 Sep 20 22:29:53.184674 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 363/749] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:52 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1265 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:53.464478 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-bc51bf34-b943-4584-836a-10289ffab388 req-26e1055b-691d-4ca3-9937-94856d79d5ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1", "tag": "44f0fe4e-7638-4e2e-98e3-eff3ce9acfe4"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:29:53.480517 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-bc51bf34-b943-4584-836a-10289ffab388 req-26e1055b-691d-4ca3-9937-94856d79d5ef service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:53.481453 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-bc51bf34-b943-4584-836a-10289ffab388 req-26e1055b-691d-4ca3-9937-94856d79d5ef service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:53.482134 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-bc51bf34-b943-4584-836a-10289ffab388 req-26e1055b-691d-4ca3-9937-94856d79d5ef service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:53.497460 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-bc51bf34-b943-4584-836a-10289ffab388 req-26e1055b-691d-4ca3-9937-94856d79d5ef service nova] Creating event network-changed:44f0fe4e-7638-4e2e-98e3-eff3ce9acfe4 for instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 on hv-cinder-85827 Sep 20 22:29:53.505049 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-bc51bf34-b943-4584-836a-10289ffab388 req-26e1055b-691d-4ca3-9937-94856d79d5ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.273197 Sep 20 22:29:53.505909 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 387/750] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:29:53.990958 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-63e1d7c4-5798-4d22-b0ee-b7e1ad3def7d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:53.991569 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-63e1d7c4-5798-4d22-b0ee-b7e1ad3def7d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:53.998763 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-63e1d7c4-5798-4d22-b0ee-b7e1ad3def7d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:53.999318 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-63e1d7c4-5798-4d22-b0ee-b7e1ad3def7d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:53.999821 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-63e1d7c4-5798-4d22-b0ee-b7e1ad3def7d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:54.000590 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-63e1d7c4-5798-4d22-b0ee-b7e1ad3def7d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:54.001182 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-63e1d7c4-5798-4d22-b0ee-b7e1ad3def7d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:54.001675 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-63e1d7c4-5798-4d22-b0ee-b7e1ad3def7d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:54.015884 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-63e1d7c4-5798-4d22-b0ee-b7e1ad3def7d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] HTTP exception thrown: Instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 could not be found. Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-63e1d7c4-5798-4d22-b0ee-b7e1ad3def7d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Request method failure captured: Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: DELETE /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 HTTP/1.1 Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj1u8Dac5LZoF9XvxzObiNZxaRtyHxJ9XJCPxEJUsZxCMmbYYjxZiqp8WdtamDDYfYrpvZPtB49n4OwOY35bDrutB_d1OI-gkcaYsYQhaL96sGaWU4DwbzLXaDsDWtPmcswXjUjTaYb7SdtEenwFZYFQiBG2KmA3RHtaz4ujsgmicSM Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: 02ff885440634a13916a25973bdde7b3 Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-AttachVolumeTestJSON-1455725482 Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:29:54.018865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:29:54.020277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02ff885440634a13916a25973bdde7b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_02ff885440634a13916a25973bdde7b3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/02ff885440634a13916a25973bdde7b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02ff885440634a13916a25973bdde7b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:29:54.020277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-AttachVolumeTestJSON-1455725482 Sep 20 22:29:54.020277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: 02ff885440634a13916a25973bdde7b3 Sep 20 22:29:54.020277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1455725482 Sep 20 22:29:54.020277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-AttachVolumeTestJSON-1455725482-project Sep 20 22:29:54.020277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:29:54.020277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:29:54.020277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: c45fbc2758e641fba97c0b3096db4f15 Sep 20 22:29:54.020277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-AttachVolumeTestJSON-1455725482-project Sep 20 22:29:54.020277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:29:54.020277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 could not be found. Sep 20 22:29:54.020277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': '383da7f3-a48b-45bf-aa96-d3eb43320ed0'} Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 could not be found. Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:29:54.021251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 could not be found. Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 could not be found. Sep 20 22:29:54.022696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:54.025010 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-63e1d7c4-5798-4d22-b0ee-b7e1ad3def7d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Returning 404 to user: Instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:29:54.025950 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-63e1d7c4-5798-4d22-b0ee-b7e1ad3def7d tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "DELETE /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 404 len: 111 microversion: 2.1 time: 0.038978 Sep 20 22:29:54.026615 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 364/751] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:29:53 2022] DELETE /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:29:54.035612 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-58c6fab9-237c-419e-b82e-479b3efe3607 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:54.036391 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-58c6fab9-237c-419e-b82e-479b3efe3607 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 383da7f3-a48b-45bf-aa96-d3eb43320ed0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:54.042716 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58c6fab9-237c-419e-b82e-479b3efe3607 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:54.043281 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58c6fab9-237c-419e-b82e-479b3efe3607 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:54.043793 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58c6fab9-237c-419e-b82e-479b3efe3607 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:54.044559 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58c6fab9-237c-419e-b82e-479b3efe3607 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:54.045153 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58c6fab9-237c-419e-b82e-479b3efe3607 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:54.045660 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58c6fab9-237c-419e-b82e-479b3efe3607 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:54.061598 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-58c6fab9-237c-419e-b82e-479b3efe3607 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] HTTP exception thrown: Instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 could not be found. Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-58c6fab9-237c-419e-b82e-479b3efe3607 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Request method failure captured: Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 HTTP/1.1 Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj1u8Dac5LZoF9XvxzObiNZxaRtyHxJ9XJCPxEJUsZxCMmbYYjxZiqp8WdtamDDYfYrpvZPtB49n4OwOY35bDrutB_d1OI-gkcaYsYQhaL96sGaWU4DwbzLXaDsDWtPmcswXjUjTaYb7SdtEenwFZYFQiBG2KmA3RHtaz4ujsgmicSM Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 02ff885440634a13916a25973bdde7b3 Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-AttachVolumeTestJSON-1455725482 Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:29:54.063325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:29:54.064704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02ff885440634a13916a25973bdde7b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_02ff885440634a13916a25973bdde7b3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/02ff885440634a13916a25973bdde7b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02ff885440634a13916a25973bdde7b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:29:54.064704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-AttachVolumeTestJSON-1455725482 Sep 20 22:29:54.064704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 02ff885440634a13916a25973bdde7b3 Sep 20 22:29:54.064704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1455725482 Sep 20 22:29:54.064704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-AttachVolumeTestJSON-1455725482-project Sep 20 22:29:54.064704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:29:54.064704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:29:54.064704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: c45fbc2758e641fba97c0b3096db4f15 Sep 20 22:29:54.064704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-AttachVolumeTestJSON-1455725482-project Sep 20 22:29:54.064704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:29:54.064704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 could not be found. Sep 20 22:29:54.064704 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': '383da7f3-a48b-45bf-aa96-d3eb43320ed0'} Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 could not be found. Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:29:54.065487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:29:54.067066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:29:54.067066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:29:54.067066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:29:54.067066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:29:54.067066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:29:54.067066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:29:54.067066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:29:54.067066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 could not be found. Sep 20 22:29:54.067066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:29:54.067066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:29:54.067066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:29:54.067066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:54.067066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:29:54.067066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:29:54.067066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:29:54.067066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:29:54.067066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 could not be found. Sep 20 22:29:54.067066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:29:54.069251 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-58c6fab9-237c-419e-b82e-479b3efe3607 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Returning 404 to user: Instance 383da7f3-a48b-45bf-aa96-d3eb43320ed0 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:29:54.069251 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-58c6fab9-237c-419e-b82e-479b3efe3607 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0" status: 404 len: 111 microversion: 2.1 time: 0.033840 Sep 20 22:29:54.069553 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 388/752] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:54 2022] GET /compute/v2.1/servers/383da7f3-a48b-45bf-aa96-d3eb43320ed0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:29:54.158059 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-35b9e1b6-b35c-4aa9-8c55-5ed382387fc6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:54.159126 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-35b9e1b6-b35c-4aa9-8c55-5ed382387fc6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:54.167686 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:29:54.169312 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-35b9e1b6-b35c-4aa9-8c55-5ed382387fc6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:54.169900 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-35b9e1b6-b35c-4aa9-8c55-5ed382387fc6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:54.170595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-35b9e1b6-b35c-4aa9-8c55-5ed382387fc6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:54.171545 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-35b9e1b6-b35c-4aa9-8c55-5ed382387fc6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:54.172249 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-35b9e1b6-b35c-4aa9-8c55-5ed382387fc6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:54.172965 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-35b9e1b6-b35c-4aa9-8c55-5ed382387fc6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:54.223396 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-1c443ca5-91b0-4837-a312-276fca5becb3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:54.223396 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-1c443ca5-91b0-4837-a312-276fca5becb3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:54.238010 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1c443ca5-91b0-4837-a312-276fca5becb3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:54.238496 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1c443ca5-91b0-4837-a312-276fca5becb3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:54.238940 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1c443ca5-91b0-4837-a312-276fca5becb3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:54.239648 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1c443ca5-91b0-4837-a312-276fca5becb3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:54.240109 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1c443ca5-91b0-4837-a312-276fca5becb3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:54.240539 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1c443ca5-91b0-4837-a312-276fca5becb3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:54.416486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-1c443ca5-91b0-4837-a312-276fca5becb3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:54.419554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:29:54.430732 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-1c443ca5-91b0-4837-a312-276fca5becb3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1265 microversion: 2.1 time: 0.220536 Sep 20 22:29:54.431356 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 389/753] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:54 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:54.523720 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-35b9e1b6-b35c-4aa9-8c55-5ed382387fc6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:54.532471 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-35b9e1b6-b35c-4aa9-8c55-5ed382387fc6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:54.534044 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-35b9e1b6-b35c-4aa9-8c55-5ed382387fc6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:54.537461 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-35b9e1b6-b35c-4aa9-8c55-5ed382387fc6 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1739 microversion: 2.20 time: 0.382550 Sep 20 22:29:54.538275 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 365/754] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:54 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1739 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:55.255259 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f238f618-0c5f-438d-ad4b-9b53413f633a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:55.256031 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-f238f618-0c5f-438d-ad4b-9b53413f633a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:55.263584 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f238f618-0c5f-438d-ad4b-9b53413f633a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:55.264322 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f238f618-0c5f-438d-ad4b-9b53413f633a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:55.264994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f238f618-0c5f-438d-ad4b-9b53413f633a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:55.265919 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f238f618-0c5f-438d-ad4b-9b53413f633a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:55.267201 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f238f618-0c5f-438d-ad4b-9b53413f633a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:55.267816 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f238f618-0c5f-438d-ad4b-9b53413f633a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:55.283093 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-f238f618-0c5f-438d-ad4b-9b53413f633a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] HTTP exception thrown: Instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 could not be found. Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f238f618-0c5f-438d-ad4b-9b53413f633a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Request method failure captured: Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: DELETE /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 HTTP/1.1 Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj1u8Dac5LZoF9XvxzObiNZxaRtyHxJ9XJCPxEJUsZxCMmbYYjxZiqp8WdtamDDYfYrpvZPtB49n4OwOY35bDrutB_d1OI-gkcaYsYQhaL96sGaWU4DwbzLXaDsDWtPmcswXjUjTaYb7SdtEenwFZYFQiBG2KmA3RHtaz4ujsgmicSM Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 02ff885440634a13916a25973bdde7b3 Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-AttachVolumeTestJSON-1455725482 Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:29:55.284651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:29:55.286233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02ff885440634a13916a25973bdde7b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_02ff885440634a13916a25973bdde7b3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/02ff885440634a13916a25973bdde7b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02ff885440634a13916a25973bdde7b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:29:55.286233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-AttachVolumeTestJSON-1455725482 Sep 20 22:29:55.286233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 02ff885440634a13916a25973bdde7b3 Sep 20 22:29:55.286233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1455725482 Sep 20 22:29:55.286233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-AttachVolumeTestJSON-1455725482-project Sep 20 22:29:55.286233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:29:55.286233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:29:55.286233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: c45fbc2758e641fba97c0b3096db4f15 Sep 20 22:29:55.286233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-AttachVolumeTestJSON-1455725482-project Sep 20 22:29:55.286233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:29:55.286233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 could not be found. Sep 20 22:29:55.286233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': '89747cc8-0eba-4b3b-8fec-ec0663bc51d0'} Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 could not be found. Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:29:55.287126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 could not be found. Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 could not be found. Sep 20 22:29:55.291762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:29:55.293218 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f238f618-0c5f-438d-ad4b-9b53413f633a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Returning 404 to user: Instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:29:55.293218 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-f238f618-0c5f-438d-ad4b-9b53413f633a tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "DELETE /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 404 len: 111 microversion: 2.1 time: 0.036388 Sep 20 22:29:55.293218 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 390/755] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:29:55 2022] DELETE /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:29:55.295452 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-509757d3-6f95-4601-af58-9da1c1190b33 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:55.296275 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-509757d3-6f95-4601-af58-9da1c1190b33 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] [instance: 89747cc8-0eba-4b3b-8fec-ec0663bc51d0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:55.303197 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-509757d3-6f95-4601-af58-9da1c1190b33 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:55.303684 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-509757d3-6f95-4601-af58-9da1c1190b33 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:55.304118 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-509757d3-6f95-4601-af58-9da1c1190b33 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:55.304813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-509757d3-6f95-4601-af58-9da1c1190b33 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:55.305292 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-509757d3-6f95-4601-af58-9da1c1190b33 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:55.305711 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-509757d3-6f95-4601-af58-9da1c1190b33 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:55.319929 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-509757d3-6f95-4601-af58-9da1c1190b33 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] HTTP exception thrown: Instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 could not be found. Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-509757d3-6f95-4601-af58-9da1c1190b33 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Request method failure captured: Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 HTTP/1.1 Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj1u8Dac5LZoF9XvxzObiNZxaRtyHxJ9XJCPxEJUsZxCMmbYYjxZiqp8WdtamDDYfYrpvZPtB49n4OwOY35bDrutB_d1OI-gkcaYsYQhaL96sGaWU4DwbzLXaDsDWtPmcswXjUjTaYb7SdtEenwFZYFQiBG2KmA3RHtaz4ujsgmicSM Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: 02ff885440634a13916a25973bdde7b3 Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-AttachVolumeTestJSON-1455725482 Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:29:55.321568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:29:55.322930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02ff885440634a13916a25973bdde7b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_02ff885440634a13916a25973bdde7b3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/02ff885440634a13916a25973bdde7b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02ff885440634a13916a25973bdde7b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:29:55.322930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-AttachVolumeTestJSON-1455725482 Sep 20 22:29:55.322930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: 02ff885440634a13916a25973bdde7b3 Sep 20 22:29:55.322930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1455725482 Sep 20 22:29:55.322930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-AttachVolumeTestJSON-1455725482-project Sep 20 22:29:55.322930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:29:55.322930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:29:55.322930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: c45fbc2758e641fba97c0b3096db4f15 Sep 20 22:29:55.322930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-AttachVolumeTestJSON-1455725482-project Sep 20 22:29:55.322930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:29:55.322930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 could not be found. Sep 20 22:29:55.322930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': '89747cc8-0eba-4b3b-8fec-ec0663bc51d0'} Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 could not be found. Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:29:55.323682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:29:55.325266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:29:55.325266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:29:55.325266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:29:55.325266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:29:55.325266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:29:55.325266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:29:55.325266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:29:55.325266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 could not be found. Sep 20 22:29:55.325266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:55.325266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:29:55.325266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:55.325266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:29:55.325266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:29:55.325266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:29:55.325266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:29:55.325266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:29:55.325266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 could not be found. Sep 20 22:29:55.325266 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:29:55.326315 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-509757d3-6f95-4601-af58-9da1c1190b33 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] Returning 404 to user: Instance 89747cc8-0eba-4b3b-8fec-ec0663bc51d0 could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:29:55.326315 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-509757d3-6f95-4601-af58-9da1c1190b33 tempest-AttachVolumeTestJSON-1455725482 tempest-AttachVolumeTestJSON-1455725482-project] 10.222.0.16 "GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0" status: 404 len: 111 microversion: 2.1 time: 0.031332 Sep 20 22:29:55.326315 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 366/756] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:55 2022] GET /compute/v2.1/servers/89747cc8-0eba-4b3b-8fec-ec0663bc51d0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:29:55.458667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a47720eb-533d-4cf0-b56c-e95ee3bf280d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:55.459435 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a47720eb-533d-4cf0-b56c-e95ee3bf280d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:55.466196 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a47720eb-533d-4cf0-b56c-e95ee3bf280d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:55.466670 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a47720eb-533d-4cf0-b56c-e95ee3bf280d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:55.467303 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a47720eb-533d-4cf0-b56c-e95ee3bf280d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:55.467991 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a47720eb-533d-4cf0-b56c-e95ee3bf280d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:55.468475 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a47720eb-533d-4cf0-b56c-e95ee3bf280d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:55.468893 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a47720eb-533d-4cf0-b56c-e95ee3bf280d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:55.564324 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-9a2ef1ba-0440-49eb-85d1-67910bf4c9aa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:55.565279 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-9a2ef1ba-0440-49eb-85d1-67910bf4c9aa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:55.572003 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9a2ef1ba-0440-49eb-85d1-67910bf4c9aa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:55.572798 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9a2ef1ba-0440-49eb-85d1-67910bf4c9aa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:55.573420 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9a2ef1ba-0440-49eb-85d1-67910bf4c9aa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:55.574308 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9a2ef1ba-0440-49eb-85d1-67910bf4c9aa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:55.574922 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9a2ef1ba-0440-49eb-85d1-67910bf4c9aa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:55.575502 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9a2ef1ba-0440-49eb-85d1-67910bf4c9aa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:55.649796 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a47720eb-533d-4cf0-b56c-e95ee3bf280d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:55.658874 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a47720eb-533d-4cf0-b56c-e95ee3bf280d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1265 microversion: 2.1 time: 0.205456 Sep 20 22:29:55.677386 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 391/757] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:55 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:55.832897 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-9a2ef1ba-0440-49eb-85d1-67910bf4c9aa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:55.842192 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-9a2ef1ba-0440-49eb-85d1-67910bf4c9aa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:55.844655 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-9a2ef1ba-0440-49eb-85d1-67910bf4c9aa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:55.846831 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-9a2ef1ba-0440-49eb-85d1-67910bf4c9aa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1739 microversion: 2.20 time: 0.286976 Sep 20 22:29:55.866907 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 367/758] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:55 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1739 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:29:56.684323 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ad3c256c-67f6-403e-81e0-43bb3beb5bfe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:56.685535 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ad3c256c-67f6-403e-81e0-43bb3beb5bfe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:56.693349 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ad3c256c-67f6-403e-81e0-43bb3beb5bfe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:56.694112 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ad3c256c-67f6-403e-81e0-43bb3beb5bfe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:56.694702 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ad3c256c-67f6-403e-81e0-43bb3beb5bfe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:56.695569 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ad3c256c-67f6-403e-81e0-43bb3beb5bfe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:56.696016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ad3c256c-67f6-403e-81e0-43bb3beb5bfe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:56.696434 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ad3c256c-67f6-403e-81e0-43bb3beb5bfe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:56.849838 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ad3c256c-67f6-403e-81e0-43bb3beb5bfe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:56.858897 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ad3c256c-67f6-403e-81e0-43bb3beb5bfe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1265 microversion: 2.1 time: 0.179682 Sep 20 22:29:56.860293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 392/759] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:56 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:56.894582 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-1e0801f4-d888-49bd-b9ba-1be6897a91b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:56.895205 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-1e0801f4-d888-49bd-b9ba-1be6897a91b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:56.902318 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1e0801f4-d888-49bd-b9ba-1be6897a91b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:56.903046 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1e0801f4-d888-49bd-b9ba-1be6897a91b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:56.903818 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1e0801f4-d888-49bd-b9ba-1be6897a91b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:56.904691 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1e0801f4-d888-49bd-b9ba-1be6897a91b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:56.905335 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1e0801f4-d888-49bd-b9ba-1be6897a91b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:56.905910 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1e0801f4-d888-49bd-b9ba-1be6897a91b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:57.141139 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-1e0801f4-d888-49bd-b9ba-1be6897a91b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:57.152029 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-1e0801f4-d888-49bd-b9ba-1be6897a91b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:57.154156 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-1e0801f4-d888-49bd-b9ba-1be6897a91b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:57.160227 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-1e0801f4-d888-49bd-b9ba-1be6897a91b0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1739 microversion: 2.20 time: 0.279648 Sep 20 22:29:57.161700 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 368/760] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:56 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:57.882622 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-da38ad86-61ae-4a5a-b468-d0976b064b4a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:57.883233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-da38ad86-61ae-4a5a-b468-d0976b064b4a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:57.892676 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-da38ad86-61ae-4a5a-b468-d0976b064b4a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:57.893456 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-da38ad86-61ae-4a5a-b468-d0976b064b4a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:57.894048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-da38ad86-61ae-4a5a-b468-d0976b064b4a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:57.894931 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-da38ad86-61ae-4a5a-b468-d0976b064b4a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:57.895592 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-da38ad86-61ae-4a5a-b468-d0976b064b4a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:57.896168 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-da38ad86-61ae-4a5a-b468-d0976b064b4a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:58.127158 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-da38ad86-61ae-4a5a-b468-d0976b064b4a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:58.134775 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-da38ad86-61ae-4a5a-b468-d0976b064b4a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1265 microversion: 2.1 time: 0.256051 Sep 20 22:29:58.154337 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 393/761] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:57 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:58.192132 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-57ede38f-c1fd-412e-9854-fecfbc1912cd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:58.192740 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-57ede38f-c1fd-412e-9854-fecfbc1912cd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:58.202399 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-57ede38f-c1fd-412e-9854-fecfbc1912cd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:58.202893 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-57ede38f-c1fd-412e-9854-fecfbc1912cd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:58.203331 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-57ede38f-c1fd-412e-9854-fecfbc1912cd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:58.204093 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-57ede38f-c1fd-412e-9854-fecfbc1912cd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:58.204584 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-57ede38f-c1fd-412e-9854-fecfbc1912cd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:58.204996 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-57ede38f-c1fd-412e-9854-fecfbc1912cd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:58.482092 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-57ede38f-c1fd-412e-9854-fecfbc1912cd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:58.494075 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-57ede38f-c1fd-412e-9854-fecfbc1912cd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:58.500297 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-57ede38f-c1fd-412e-9854-fecfbc1912cd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:58.502912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-57ede38f-c1fd-412e-9854-fecfbc1912cd tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1739 microversion: 2.20 time: 0.315211 Sep 20 22:29:58.504151 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 369/762] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:58 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1739 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:29:59.168496 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5db7b90f-f9f1-4e5e-b158-f847f93e81eb tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:59.169811 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5db7b90f-f9f1-4e5e-b158-f847f93e81eb tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:59.179947 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=2 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:29:59.185065 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=6 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:29:59.194358 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5db7b90f-f9f1-4e5e-b158-f847f93e81eb tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:59.205603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5db7b90f-f9f1-4e5e-b158-f847f93e81eb tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:59.206468 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5db7b90f-f9f1-4e5e-b158-f847f93e81eb tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:59.207804 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5db7b90f-f9f1-4e5e-b158-f847f93e81eb tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:59.208790 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5db7b90f-f9f1-4e5e-b158-f847f93e81eb tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:59.209567 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5db7b90f-f9f1-4e5e-b158-f847f93e81eb tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:59.530358 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-540ad665-f134-43c5-9a00-e88d71040879 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:29:59.532275 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-540ad665-f134-43c5-9a00-e88d71040879 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:29:59.534799 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=2 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:29:59.541416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-540ad665-f134-43c5-9a00-e88d71040879 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:59.542184 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-540ad665-f134-43c5-9a00-e88d71040879 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:59.542873 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-540ad665-f134-43c5-9a00-e88d71040879 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:59.543828 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-540ad665-f134-43c5-9a00-e88d71040879 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:29:59.544572 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-540ad665-f134-43c5-9a00-e88d71040879 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:29:59.545286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-540ad665-f134-43c5-9a00-e88d71040879 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:29:59.592397 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-5db7b90f-f9f1-4e5e-b158-f847f93e81eb tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:59.628238 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5db7b90f-f9f1-4e5e-b158-f847f93e81eb tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1265 microversion: 2.1 time: 0.464094 Sep 20 22:29:59.631353 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 394/763] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:29:59 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1265 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:29:59.769819 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-540ad665-f134-43c5-9a00-e88d71040879 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:59.794069 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-540ad665-f134-43c5-9a00-e88d71040879 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:59.795768 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-540ad665-f134-43c5-9a00-e88d71040879 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:29:59.797188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-540ad665-f134-43c5-9a00-e88d71040879 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1739 microversion: 2.20 time: 0.270975 Sep 20 22:29:59.813170 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 370/764] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:29:59 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:00.656044 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-0a02fefa-a70d-4127-ba6e-fe6cf6b206e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:00.656671 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-0a02fefa-a70d-4127-ba6e-fe6cf6b206e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:00.669002 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0a02fefa-a70d-4127-ba6e-fe6cf6b206e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:00.669489 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0a02fefa-a70d-4127-ba6e-fe6cf6b206e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:00.672537 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0a02fefa-a70d-4127-ba6e-fe6cf6b206e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:00.673611 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0a02fefa-a70d-4127-ba6e-fe6cf6b206e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:00.674308 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0a02fefa-a70d-4127-ba6e-fe6cf6b206e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:00.674886 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0a02fefa-a70d-4127-ba6e-fe6cf6b206e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:00.825290 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-30fbee72-76a2-4b35-882a-ebef0ae42ba5 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:00.826535 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-30fbee72-76a2-4b35-882a-ebef0ae42ba5 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:00.838576 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30fbee72-76a2-4b35-882a-ebef0ae42ba5 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:00.839407 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30fbee72-76a2-4b35-882a-ebef0ae42ba5 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:00.840094 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30fbee72-76a2-4b35-882a-ebef0ae42ba5 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:00.840996 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30fbee72-76a2-4b35-882a-ebef0ae42ba5 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:00.841810 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30fbee72-76a2-4b35-882a-ebef0ae42ba5 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:00.842431 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30fbee72-76a2-4b35-882a-ebef0ae42ba5 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:00.895949 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-0a02fefa-a70d-4127-ba6e-fe6cf6b206e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:00.905795 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-0a02fefa-a70d-4127-ba6e-fe6cf6b206e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1265 microversion: 2.1 time: 0.254657 Sep 20 22:30:00.908540 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 395/765] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:00 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:01.014892 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-30fbee72-76a2-4b35-882a-ebef0ae42ba5 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:01.026495 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-30fbee72-76a2-4b35-882a-ebef0ae42ba5 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:01.028112 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-30fbee72-76a2-4b35-882a-ebef0ae42ba5 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:01.029431 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-30fbee72-76a2-4b35-882a-ebef0ae42ba5 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1739 microversion: 2.20 time: 0.207974 Sep 20 22:30:01.030098 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 371/766] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:00 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:30:01.537446 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-57058248-3d62-42cc-b023-02c27b63a893 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Action: 'create', calling method: .version_select at 0x7f24f68d1310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1889246945"}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:30:01.914851 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-57058248-3d62-42cc-b023-02c27b63a893 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.533483 Sep 20 22:30:01.915472 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 396/767] 10.222.0.16 () {60 vars in 1155 bytes} [Tue Sep 20 22:30:01 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 535 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 20 22:30:01.928704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-aba63f53-98f2-451d-a731-e26cee8347bf tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Calling method '.version_select at 0x7f24f673a3a0>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:01.931345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ab064e29-d5d0-47ae-8cf0-b025597e2f55 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:01.932204 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ab064e29-d5d0-47ae-8cf0-b025597e2f55 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:01.942822 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ab064e29-d5d0-47ae-8cf0-b025597e2f55 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:01.943649 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ab064e29-d5d0-47ae-8cf0-b025597e2f55 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:01.944092 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ab064e29-d5d0-47ae-8cf0-b025597e2f55 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:01.944830 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ab064e29-d5d0-47ae-8cf0-b025597e2f55 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:01.945343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ab064e29-d5d0-47ae-8cf0-b025597e2f55 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:01.945775 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ab064e29-d5d0-47ae-8cf0-b025597e2f55 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:02.016232 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-aba63f53-98f2-451d-a731-e26cee8347bf tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/bde92b26-828a-4b5b-bf6b-099f701353ce" status: 200 len: 345 microversion: 2.1 time: 0.091312 Sep 20 22:30:02.017596 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 372/768] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 20 22:30:01 2022] GET /compute/v2.1/os-volumes/bde92b26-828a-4b5b-bf6b-099f701353ce => generated 345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:30:02.061185 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-de712166-8a28-410a-b8ad-aca886717e41 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:02.061922 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-de712166-8a28-410a-b8ad-aca886717e41 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:02.069475 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-de712166-8a28-410a-b8ad-aca886717e41 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:02.070058 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-de712166-8a28-410a-b8ad-aca886717e41 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:02.070571 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-de712166-8a28-410a-b8ad-aca886717e41 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:02.071537 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-de712166-8a28-410a-b8ad-aca886717e41 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:02.072092 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-de712166-8a28-410a-b8ad-aca886717e41 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:02.072583 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-de712166-8a28-410a-b8ad-aca886717e41 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:02.112579 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ab064e29-d5d0-47ae-8cf0-b025597e2f55 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:02.120901 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ab064e29-d5d0-47ae-8cf0-b025597e2f55 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1265 microversion: 2.1 time: 0.194758 Sep 20 22:30:02.121691 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 397/769] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:01 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:30:02.216399 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-de712166-8a28-410a-b8ad-aca886717e41 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:02.225366 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-de712166-8a28-410a-b8ad-aca886717e41 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:02.226828 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-de712166-8a28-410a-b8ad-aca886717e41 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:02.227999 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-de712166-8a28-410a-b8ad-aca886717e41 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1739 microversion: 2.20 time: 0.173216 Sep 20 22:30:02.228563 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 373/770] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:02 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:03.034248 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-37076984-a343-401c-80ad-86bb08cee9e8 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Calling method '.version_select at 0x7f24f66b2820>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:03.081681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-37076984-a343-401c-80ad-86bb08cee9e8 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/bde92b26-828a-4b5b-bf6b-099f701353ce" status: 200 len: 346 microversion: 2.1 time: 0.051812 Sep 20 22:30:03.082388 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 398/771] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 20 22:30:03 2022] GET /compute/v2.1/os-volumes/bde92b26-828a-4b5b-bf6b-099f701353ce => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:30:03.095736 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-eb315b4f-b9b4-4bbf-8509-52b6ee1f52b2 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Action: 'create', calling method: .version_select at 0x7f24f673a9d0>, body: {"snapshot": {"volume_id": "bde92b26-828a-4b5b-bf6b-099f701353ce", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-524566371"}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:30:03.144102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-042f8af2-0b39-45f4-8073-f518cab3500c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:03.144743 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-042f8af2-0b39-45f4-8073-f518cab3500c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:03.152554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-042f8af2-0b39-45f4-8073-f518cab3500c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:03.153163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-042f8af2-0b39-45f4-8073-f518cab3500c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:03.153610 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-042f8af2-0b39-45f4-8073-f518cab3500c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:03.154340 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-042f8af2-0b39-45f4-8073-f518cab3500c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:03.154828 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-042f8af2-0b39-45f4-8073-f518cab3500c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:03.155252 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-042f8af2-0b39-45f4-8073-f518cab3500c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:03.262739 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-eb315b4f-b9b4-4bbf-8509-52b6ee1f52b2 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.171362 Sep 20 22:30:03.263618 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 374/772] 10.222.0.16 () {60 vars in 1162 bytes} [Tue Sep 20 22:30:03 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:30:03.277904 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-387903c0-90c3-4149-9639-88dbbff0971f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:03.278706 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-387903c0-90c3-4149-9639-88dbbff0971f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:03.287195 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-387903c0-90c3-4149-9639-88dbbff0971f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:03.288602 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-387903c0-90c3-4149-9639-88dbbff0971f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:03.289336 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-387903c0-90c3-4149-9639-88dbbff0971f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:03.290541 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-387903c0-90c3-4149-9639-88dbbff0971f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:03.291003 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-387903c0-90c3-4149-9639-88dbbff0971f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:03.291425 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-387903c0-90c3-4149-9639-88dbbff0971f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:03.307297 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=100 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:03.320366 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-042f8af2-0b39-45f4-8073-f518cab3500c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:03.328677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-042f8af2-0b39-45f4-8073-f518cab3500c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1265 microversion: 2.1 time: 0.188864 Sep 20 22:30:03.329822 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 399/773] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:03 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:30:03.338587 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5f2b9bfb-3d41-43b8-8aba-a75d5cf96502 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Calling method '.version_select at 0x7f24f66b2dc0>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:03.369770 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5f2b9bfb-3d41-43b8-8aba-a75d5cf96502 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5672f179-7b8f-4157-816e-fabf0b909f42" status: 200 len: 286 microversion: 2.1 time: 0.035456 Sep 20 22:30:03.370538 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 400/774] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 20 22:30:03 2022] GET /compute/v2.1/os-snapshots/5672f179-7b8f-4157-816e-fabf0b909f42 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:30:03.381981 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-46423391-2ca9-4cea-9bcc-a357a3e675fe tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Calling method '.version_select at 0x7f24f66e18b0>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:03.429406 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-46423391-2ca9-4cea-9bcc-a357a3e675fe tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.048751 Sep 20 22:30:03.430802 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 401/775] 10.222.0.16 () {58 vars in 1140 bytes} [Tue Sep 20 22:30:03 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:30:03.442056 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c7e2e17f-d91a-44e6-aa2f-561d1a61a8b3 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Calling method '.version_select at 0x7f24f6733670>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:03.473323 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c7e2e17f-d91a-44e6-aa2f-561d1a61a8b3 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5672f179-7b8f-4157-816e-fabf0b909f42" status: 200 len: 286 microversion: 2.1 time: 0.035851 Sep 20 22:30:03.478923 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 402/776] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 20 22:30:03 2022] GET /compute/v2.1/os-snapshots/5672f179-7b8f-4157-816e-fabf0b909f42 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:30:03.542446 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-387903c0-90c3-4149-9639-88dbbff0971f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:03.550491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-387903c0-90c3-4149-9639-88dbbff0971f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:03.551962 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-387903c0-90c3-4149-9639-88dbbff0971f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:03.553160 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-387903c0-90c3-4149-9639-88dbbff0971f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1721 microversion: 2.20 time: 0.279806 Sep 20 22:30:03.553727 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 375/777] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:03 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:04.352165 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-28f3c195-bc5d-406f-a463-1a1d6ee751fc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:04.352772 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-28f3c195-bc5d-406f-a463-1a1d6ee751fc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:04.358745 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-28f3c195-bc5d-406f-a463-1a1d6ee751fc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:04.359224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-28f3c195-bc5d-406f-a463-1a1d6ee751fc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:04.359652 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-28f3c195-bc5d-406f-a463-1a1d6ee751fc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:04.361027 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-28f3c195-bc5d-406f-a463-1a1d6ee751fc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:04.361474 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-28f3c195-bc5d-406f-a463-1a1d6ee751fc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:04.361893 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-28f3c195-bc5d-406f-a463-1a1d6ee751fc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:04.486187 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-43391c37-b472-448e-bff3-e196456796ba tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Calling method '.version_select at 0x7f24f67a4790>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:04.495681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-28f3c195-bc5d-406f-a463-1a1d6ee751fc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:04.503715 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-28f3c195-bc5d-406f-a463-1a1d6ee751fc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1265 microversion: 2.1 time: 0.155910 Sep 20 22:30:04.508910 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 403/778] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:04 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:04.518494 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-43391c37-b472-448e-bff3-e196456796ba tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5672f179-7b8f-4157-816e-fabf0b909f42" status: 200 len: 286 microversion: 2.1 time: 0.036135 Sep 20 22:30:04.519263 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 376/779] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 20 22:30:04 2022] GET /compute/v2.1/os-snapshots/5672f179-7b8f-4157-816e-fabf0b909f42 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:30:04.579713 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-71a9b8cd-4307-450c-a4ae-7c6015046244 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:04.580355 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-71a9b8cd-4307-450c-a4ae-7c6015046244 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:04.586471 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-71a9b8cd-4307-450c-a4ae-7c6015046244 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:04.586982 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-71a9b8cd-4307-450c-a4ae-7c6015046244 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:04.587419 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-71a9b8cd-4307-450c-a4ae-7c6015046244 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:04.588106 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-71a9b8cd-4307-450c-a4ae-7c6015046244 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:04.588559 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-71a9b8cd-4307-450c-a4ae-7c6015046244 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:04.588991 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-71a9b8cd-4307-450c-a4ae-7c6015046244 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:04.721524 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-71a9b8cd-4307-450c-a4ae-7c6015046244 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:04.729498 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-71a9b8cd-4307-450c-a4ae-7c6015046244 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:04.730945 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-71a9b8cd-4307-450c-a4ae-7c6015046244 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:04.732098 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-71a9b8cd-4307-450c-a4ae-7c6015046244 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1721 microversion: 2.20 time: 0.156387 Sep 20 22:30:04.733048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 404/780] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:04 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:05.527601 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-f1df754f-5a3b-4129-8112-e84299dcb122 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:05.528355 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-f1df754f-5a3b-4129-8112-e84299dcb122 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:05.531089 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-1b6a62df-e050-429b-b374-c2d31ee545db tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Calling method '.version_select at 0x7f24f67665e0>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:05.535103 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f1df754f-5a3b-4129-8112-e84299dcb122 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:05.535582 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f1df754f-5a3b-4129-8112-e84299dcb122 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:05.536011 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f1df754f-5a3b-4129-8112-e84299dcb122 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:05.536692 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f1df754f-5a3b-4129-8112-e84299dcb122 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:05.537181 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f1df754f-5a3b-4129-8112-e84299dcb122 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:05.537600 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f1df754f-5a3b-4129-8112-e84299dcb122 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:05.561615 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-1b6a62df-e050-429b-b374-c2d31ee545db tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5672f179-7b8f-4157-816e-fabf0b909f42" status: 200 len: 286 microversion: 2.1 time: 0.034134 Sep 20 22:30:05.562189 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 405/781] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 20 22:30:05 2022] GET /compute/v2.1/os-snapshots/5672f179-7b8f-4157-816e-fabf0b909f42 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:30:05.666335 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f1df754f-5a3b-4129-8112-e84299dcb122 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:05.673956 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-f1df754f-5a3b-4129-8112-e84299dcb122 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1265 microversion: 2.1 time: 0.150715 Sep 20 22:30:05.674519 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 377/782] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:05 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:05.758836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-60576e79-9bfe-444f-88b2-f25d1e7fd9f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:05.759442 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-60576e79-9bfe-444f-88b2-f25d1e7fd9f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:05.765403 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-60576e79-9bfe-444f-88b2-f25d1e7fd9f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:05.765903 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-60576e79-9bfe-444f-88b2-f25d1e7fd9f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:05.766952 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-60576e79-9bfe-444f-88b2-f25d1e7fd9f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:05.767671 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-60576e79-9bfe-444f-88b2-f25d1e7fd9f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:05.768120 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-60576e79-9bfe-444f-88b2-f25d1e7fd9f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:05.768538 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-60576e79-9bfe-444f-88b2-f25d1e7fd9f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:05.895830 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-60576e79-9bfe-444f-88b2-f25d1e7fd9f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:05.903776 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-60576e79-9bfe-444f-88b2-f25d1e7fd9f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:05.905240 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-60576e79-9bfe-444f-88b2-f25d1e7fd9f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:05.906385 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-60576e79-9bfe-444f-88b2-f25d1e7fd9f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1721 microversion: 2.20 time: 0.151393 Sep 20 22:30:05.909175 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 406/783] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:05 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:06.574311 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-94f3ef2d-a380-4a37-b09b-7ca3ec5fb45d tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Calling method '.version_select at 0x7f24f67b7820>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:06.608239 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-94f3ef2d-a380-4a37-b09b-7ca3ec5fb45d tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5672f179-7b8f-4157-816e-fabf0b909f42" status: 200 len: 287 microversion: 2.1 time: 0.037884 Sep 20 22:30:06.608906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 378/784] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 20 22:30:06 2022] GET /compute/v2.1/os-snapshots/5672f179-7b8f-4157-816e-fabf0b909f42 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:30:06.620854 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b36533d9-0799-4977-8732-5fd1b47e6719 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Calling method '.version_select at 0x7f24f670b670>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:06.686301 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b36533d9-0799-4977-8732-5fd1b47e6719 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/5672f179-7b8f-4157-816e-fabf0b909f42" status: 202 len: 0 microversion: 2.1 time: 0.069280 Sep 20 22:30:06.686937 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 407/785] 10.222.0.16 () {58 vars in 1254 bytes} [Tue Sep 20 22:30:06 2022] DELETE /compute/v2.1/os-snapshots/5672f179-7b8f-4157-816e-fabf0b909f42 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:30:06.695925 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-daccd726-fb40-4f2d-8119-6e7df58c28df tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Calling method '.version_select at 0x7f24f67d5d30>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:06.699582 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a53fc762-25b1-4880-b727-fa6c055d6262 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:06.700857 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a53fc762-25b1-4880-b727-fa6c055d6262 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:06.708539 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a53fc762-25b1-4880-b727-fa6c055d6262 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:06.709058 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a53fc762-25b1-4880-b727-fa6c055d6262 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:06.709546 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a53fc762-25b1-4880-b727-fa6c055d6262 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:06.710288 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a53fc762-25b1-4880-b727-fa6c055d6262 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:06.710709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a53fc762-25b1-4880-b727-fa6c055d6262 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:06.711192 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a53fc762-25b1-4880-b727-fa6c055d6262 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:06.729798 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-daccd726-fb40-4f2d-8119-6e7df58c28df tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5672f179-7b8f-4157-816e-fabf0b909f42" status: 200 len: 286 microversion: 2.1 time: 0.038243 Sep 20 22:30:06.730636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 379/786] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 20 22:30:06 2022] GET /compute/v2.1/os-snapshots/5672f179-7b8f-4157-816e-fabf0b909f42 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:30:06.784180 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-5b6ac82d-abb5-4500-8dd7-201520ff1d2b req-85be7d99-76b0-4345-89a1-37b6cf520ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1", "name": "network-vif-plugged", "status": "completed", "tag": "44f0fe4e-7638-4e2e-98e3-eff3ce9acfe4"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:30:06.795528 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-5b6ac82d-abb5-4500-8dd7-201520ff1d2b req-85be7d99-76b0-4345-89a1-37b6cf520ff0 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:06.796395 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-5b6ac82d-abb5-4500-8dd7-201520ff1d2b req-85be7d99-76b0-4345-89a1-37b6cf520ff0 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:06.796825 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-5b6ac82d-abb5-4500-8dd7-201520ff1d2b req-85be7d99-76b0-4345-89a1-37b6cf520ff0 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:06.810105 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-5b6ac82d-abb5-4500-8dd7-201520ff1d2b req-85be7d99-76b0-4345-89a1-37b6cf520ff0 service nova] Creating event network-vif-plugged:44f0fe4e-7638-4e2e-98e3-eff3ce9acfe4 for instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 on hv-cinder-85827 Sep 20 22:30:06.815271 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-5b6ac82d-abb5-4500-8dd7-201520ff1d2b req-85be7d99-76b0-4345-89a1-37b6cf520ff0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035403 Sep 20 22:30:06.815893 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 380/787] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:30:06.879862 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a53fc762-25b1-4880-b727-fa6c055d6262 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:06.888833 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a53fc762-25b1-4880-b727-fa6c055d6262 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1265 microversion: 2.1 time: 0.196252 Sep 20 22:30:06.904456 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 408/788] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:06 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:30:06.932686 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-4dabc568-7fee-4b28-ac4e-b3f90461e002 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:06.933451 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-4dabc568-7fee-4b28-ac4e-b3f90461e002 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:06.940180 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4dabc568-7fee-4b28-ac4e-b3f90461e002 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:06.940659 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4dabc568-7fee-4b28-ac4e-b3f90461e002 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:06.941117 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4dabc568-7fee-4b28-ac4e-b3f90461e002 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:06.941800 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4dabc568-7fee-4b28-ac4e-b3f90461e002 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:06.942249 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4dabc568-7fee-4b28-ac4e-b3f90461e002 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:06.942667 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4dabc568-7fee-4b28-ac4e-b3f90461e002 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:07.081429 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-4dabc568-7fee-4b28-ac4e-b3f90461e002 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:07.089569 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-4dabc568-7fee-4b28-ac4e-b3f90461e002 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:07.091024 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-4dabc568-7fee-4b28-ac4e-b3f90461e002 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:07.092198 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-4dabc568-7fee-4b28-ac4e-b3f90461e002 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1721 microversion: 2.20 time: 0.164115 Sep 20 22:30:07.092745 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 381/789] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:06 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:07.742956 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c37ec772-a6f3-45ac-ab8d-c4664c11b18c tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Calling method '.version_select at 0x7f24f66b2af0>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:07.769987 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-c37ec772-a6f3-45ac-ab8d-c4664c11b18c tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] HTTP exception thrown: Snapshot 5672f179-7b8f-4157-816e-fabf0b909f42 could not be found. Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c37ec772-a6f3-45ac-ab8d-c4664c11b18c tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Request method failure captured: Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/os-snapshots/5672f179-7b8f-4157-816e-fabf0b909f42 HTTP/1.1 Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj7pyDOxmHXAx2P5SmueRbjiHCj-0ww3Ks2MgCuY1TL73bAwjsGkwbqSUwCy0zcC9k_8G1woExI4-d_lEuWhZ1FuAglDJOiJDLBav80OwRuLi68DwFchmib1aeWDwH2KCwiMFlwJk6lpeM-VFPR0OEBuD__onMwcUl80lDQPkn74wvU Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: dd209174362648ee8e5a3699eb14509f Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-812089082 Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:30:07.772214 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:30:07.773690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd209174362648ee8e5a3699eb14509f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dd209174362648ee8e5a3699eb14509f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dd209174362648ee8e5a3699eb14509f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd209174362648ee8e5a3699eb14509f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:30:07.773690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-VolumesSnapshotsTestJSON-812089082 Sep 20 22:30:07.773690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: dd209174362648ee8e5a3699eb14509f Sep 20 22:30:07.773690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-812089082 Sep 20 22:30:07.773690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-VolumesSnapshotsTestJSON-812089082-project Sep 20 22:30:07.773690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:30:07.773690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:30:07.773690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 90fb523044c74e3fbf4d08c182e32215 Sep 20 22:30:07.773690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-VolumesSnapshotsTestJSON-812089082-project Sep 20 22:30:07.773690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: Sep 20 22:30:07.773690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Snapshot 5672f179-7b8f-4157-816e-fabf0b909f42 could not be found. Sep 20 22:30:07.773690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': '5672f179-7b8f-4157-816e-fabf0b909f42'} Sep 20 22:30:07.773690 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:30:07.774609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:30:07.774609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 20 22:30:07.774609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 20 22:30:07.774609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 20 22:30:07.774609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 20 22:30:07.774609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 20 22:30:07.774609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 20 22:30:07.774609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 22:30:07.774609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 22:30:07.774609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 22:30:07.774609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 22:30:07.774609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 22:30:07.774609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 22:30:07.774609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 22:30:07.774609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 22:30:07.774609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5672f179-7b8f-4157-816e-fabf0b909f42 could not be found. (HTTP 404) (Request-ID: req-58e8c72f-3ff6-43c8-b6c3-30273250c07b) Sep 20 22:30:07.774609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:30:07.774609 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 22:30:07.776180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5672f179-7b8f-4157-816e-fabf0b909f42 could not be found. Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 20 22:30:07.777560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:30:07.779078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5672f179-7b8f-4157-816e-fabf0b909f42 could not be found. Sep 20 22:30:07.779078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:30:07.779078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:30:07.779078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:30:07.779078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:30:07.779078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:30:07.779078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:30:07.779078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:30:07.779078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:30:07.779078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5672f179-7b8f-4157-816e-fabf0b909f42 could not be found. Sep 20 22:30:07.779078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:30:07.779078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c37ec772-a6f3-45ac-ab8d-c4664c11b18c tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Returning 404 to user: Snapshot 5672f179-7b8f-4157-816e-fabf0b909f42 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:30:07.779078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c37ec772-a6f3-45ac-ab8d-c4664c11b18c tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5672f179-7b8f-4157-816e-fabf0b909f42" status: 404 len: 111 microversion: 2.1 time: 0.035276 Sep 20 22:30:07.779078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 409/790] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 20 22:30:07 2022] GET /compute/v2.1/os-snapshots/5672f179-7b8f-4157-816e-fabf0b909f42 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:30:07.782480 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-1774b6d1-e0da-4995-b730-700c759f8573 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Calling method '.version_select at 0x7f24f6758d30>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:07.850397 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-1774b6d1-e0da-4995-b730-700c759f8573 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/bde92b26-828a-4b5b-bf6b-099f701353ce" status: 202 len: 0 microversion: 2.1 time: 0.071520 Sep 20 22:30:07.851058 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 382/791] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 20 22:30:07 2022] DELETE /compute/v2.1/os-volumes/bde92b26-828a-4b5b-bf6b-099f701353ce => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 22:30:07.860413 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-20de2b0a-c0c9-4e61-9807-9c98a260962a tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Calling method '.version_select at 0x7f24f672f9d0>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:07.911919 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-f296f8f2-a270-460a-bea9-c70b08589c06 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:07.920759 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-f296f8f2-a270-460a-bea9-c70b08589c06 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:07.933548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f296f8f2-a270-460a-bea9-c70b08589c06 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:07.934988 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f296f8f2-a270-460a-bea9-c70b08589c06 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:07.935441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f296f8f2-a270-460a-bea9-c70b08589c06 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:07.936172 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f296f8f2-a270-460a-bea9-c70b08589c06 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:07.936554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-20de2b0a-c0c9-4e61-9807-9c98a260962a tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/bde92b26-828a-4b5b-bf6b-099f701353ce" status: 200 len: 345 microversion: 2.1 time: 0.080917 Sep 20 22:30:07.936695 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f296f8f2-a270-460a-bea9-c70b08589c06 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:07.937621 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 410/792] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 20 22:30:07 2022] GET /compute/v2.1/os-volumes/bde92b26-828a-4b5b-bf6b-099f701353ce => generated 345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:30:07.938927 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f296f8f2-a270-460a-bea9-c70b08589c06 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:08.117088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a1481dde-12b3-44fd-95a2-81bbd48d056c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:08.117949 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a1481dde-12b3-44fd-95a2-81bbd48d056c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:08.131150 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a1481dde-12b3-44fd-95a2-81bbd48d056c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:08.132022 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a1481dde-12b3-44fd-95a2-81bbd48d056c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:08.132468 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a1481dde-12b3-44fd-95a2-81bbd48d056c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:08.133498 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a1481dde-12b3-44fd-95a2-81bbd48d056c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:08.134340 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a1481dde-12b3-44fd-95a2-81bbd48d056c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:08.134817 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a1481dde-12b3-44fd-95a2-81bbd48d056c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:08.210412 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f296f8f2-a270-460a-bea9-c70b08589c06 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:08.218463 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-f296f8f2-a270-460a-bea9-c70b08589c06 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1265 microversion: 2.1 time: 0.310361 Sep 20 22:30:08.220865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 383/793] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:07 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:08.299360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a1481dde-12b3-44fd-95a2-81bbd48d056c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:08.308102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a1481dde-12b3-44fd-95a2-81bbd48d056c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:08.309636 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a1481dde-12b3-44fd-95a2-81bbd48d056c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:08.310788 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a1481dde-12b3-44fd-95a2-81bbd48d056c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1724 microversion: 2.20 time: 0.197578 Sep 20 22:30:08.311336 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 411/794] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:08 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:08.336420 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ec26f395-798c-408d-bbda-abbee66b3f05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0558e320-c190-4891-ae90-318fee841e8c"}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:30:08.338900 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ec26f395-798c-408d-bbda-abbee66b3f05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:08.346343 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ec26f395-798c-408d-bbda-abbee66b3f05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:08.347039 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ec26f395-798c-408d-bbda-abbee66b3f05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:08.347476 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ec26f395-798c-408d-bbda-abbee66b3f05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:08.348199 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ec26f395-798c-408d-bbda-abbee66b3f05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:08.348694 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ec26f395-798c-408d-bbda-abbee66b3f05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:08.349152 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ec26f395-798c-408d-bbda-abbee66b3f05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:08.647737 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ec26f395-798c-408d-bbda-abbee66b3f05 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "POST /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.315253 Sep 20 22:30:08.648484 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 384/795] 10.222.0.16 () {62 vars in 1364 bytes} [Tue Sep 20 22:30:08 2022] POST /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7/os-volume_attachments => generated 188 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 20 22:30:08.775837 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-6d5802c8-7e4a-4daa-80d3-1e8e2a59f4ec tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:08.776330 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-6d5802c8-7e4a-4daa-80d3-1e8e2a59f4ec tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:08.783038 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6d5802c8-7e4a-4daa-80d3-1e8e2a59f4ec tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:08.783511 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6d5802c8-7e4a-4daa-80d3-1e8e2a59f4ec tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:08.783934 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6d5802c8-7e4a-4daa-80d3-1e8e2a59f4ec tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:08.784610 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6d5802c8-7e4a-4daa-80d3-1e8e2a59f4ec tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:08.785081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6d5802c8-7e4a-4daa-80d3-1e8e2a59f4ec tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:08.785493 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6d5802c8-7e4a-4daa-80d3-1e8e2a59f4ec tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:08.951632 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-491b8076-8259-410f-8a1d-e1706378839f tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Calling method '.version_select at 0x7f24f67a4ee0>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:08.983542 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-491b8076-8259-410f-8a1d-e1706378839f tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] HTTP exception thrown: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-491b8076-8259-410f-8a1d-e1706378839f tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Request method failure captured: Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: GET /compute/v2.1/os-volumes/bde92b26-828a-4b5b-bf6b-099f701353ce HTTP/1.1 Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj7pyDOxmHXAx2P5SmueRbjiHCj-0ww3Ks2MgCuY1TL73bAwjsGkwbqSUwCy0zcC9k_8G1woExI4-d_lEuWhZ1FuAglDJOiJDLBav80OwRuLi68DwFchmib1aeWDwH2KCwiMFlwJk6lpeM-VFPR0OEBuD__onMwcUl80lDQPkn74wvU Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: dd209174362648ee8e5a3699eb14509f Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-812089082 Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:30:08.987261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:30:08.988789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd209174362648ee8e5a3699eb14509f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dd209174362648ee8e5a3699eb14509f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dd209174362648ee8e5a3699eb14509f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd209174362648ee8e5a3699eb14509f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:30:08.988789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-VolumesSnapshotsTestJSON-812089082 Sep 20 22:30:08.988789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: dd209174362648ee8e5a3699eb14509f Sep 20 22:30:08.988789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-812089082 Sep 20 22:30:08.988789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-VolumesSnapshotsTestJSON-812089082-project Sep 20 22:30:08.988789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:30:08.988789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:30:08.988789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 90fb523044c74e3fbf4d08c182e32215 Sep 20 22:30:08.988789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-VolumesSnapshotsTestJSON-812089082-project Sep 20 22:30:08.988789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: Sep 20 22:30:08.988789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. Sep 20 22:30:08.988789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': 'bde92b26-828a-4b5b-bf6b-099f701353ce'} Sep 20 22:30:08.988789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. (HTTP 404) (Request-ID: req-9c4212c4-2409-4ac7-8931-b03cb96f3f1a) Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:30:08.993742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 22:30:08.995188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 20 22:30:08.996701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:30:08.998234 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. Sep 20 22:30:08.998234 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:30:08.998234 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:30:08.998234 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:30:08.998234 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:30:08.998234 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:30:08.998234 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:30:08.998234 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:30:08.998234 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:30:08.998234 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. Sep 20 22:30:08.998234 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:30:08.998234 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-491b8076-8259-410f-8a1d-e1706378839f tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Returning 404 to user: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:30:08.998234 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-491b8076-8259-410f-8a1d-e1706378839f tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/bde92b26-828a-4b5b-bf6b-099f701353ce" status: 404 len: 109 microversion: 2.1 time: 0.040850 Sep 20 22:30:08.998234 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 385/796] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 20 22:30:08 2022] GET /compute/v2.1/os-volumes/bde92b26-828a-4b5b-bf6b-099f701353ce => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 22:30:09.008298 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-76623c6b-8c0b-48e6-8ebd-3c3d0553b199 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Calling method '.version_select at 0x7f24f7ef1dc0>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:09.024682 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-6d5802c8-7e4a-4daa-80d3-1e8e2a59f4ec tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "DELETE /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7/os-volume_attachments/0558e320-c190-4891-ae90-318fee841e8c" status: 202 len: 0 microversion: 2.20 time: 0.252854 Sep 20 22:30:09.025487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 412/797] 10.222.0.16 () {60 vars in 1457 bytes} [Tue Sep 20 22:30:08 2022] DELETE /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7/os-volume_attachments/0558e320-c190-4891-ae90-318fee841e8c => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:30:09.038563 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-76623c6b-8c0b-48e6-8ebd-3c3d0553b199 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] HTTP exception thrown: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-76623c6b-8c0b-48e6-8ebd-3c3d0553b199 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Request method failure captured: Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: DELETE /compute/v2.1/os-volumes/bde92b26-828a-4b5b-bf6b-099f701353ce HTTP/1.1 Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj7pyDOxmHXAx2P5SmueRbjiHCj-0ww3Ks2MgCuY1TL73bAwjsGkwbqSUwCy0zcC9k_8G1woExI4-d_lEuWhZ1FuAglDJOiJDLBav80OwRuLi68DwFchmib1aeWDwH2KCwiMFlwJk6lpeM-VFPR0OEBuD__onMwcUl80lDQPkn74wvU Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: dd209174362648ee8e5a3699eb14509f Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-812089082 Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:30:09.040503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:30:09.042048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd209174362648ee8e5a3699eb14509f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dd209174362648ee8e5a3699eb14509f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dd209174362648ee8e5a3699eb14509f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd209174362648ee8e5a3699eb14509f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:30:09.042048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-VolumesSnapshotsTestJSON-812089082 Sep 20 22:30:09.042048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: dd209174362648ee8e5a3699eb14509f Sep 20 22:30:09.042048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-812089082 Sep 20 22:30:09.042048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-VolumesSnapshotsTestJSON-812089082-project Sep 20 22:30:09.042048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:30:09.042048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:30:09.042048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 90fb523044c74e3fbf4d08c182e32215 Sep 20 22:30:09.042048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-VolumesSnapshotsTestJSON-812089082-project Sep 20 22:30:09.042048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: Sep 20 22:30:09.042048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. Sep 20 22:30:09.042048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': 'bde92b26-828a-4b5b-bf6b-099f701353ce'} Sep 20 22:30:09.042048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. (HTTP 404) (Request-ID: req-31d26fc8-b6f8-46a0-ae50-dbb67ff7fa0d) Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:30:09.042982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 20 22:30:09.044529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 20 22:30:09.045933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:30:09.047241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. Sep 20 22:30:09.047241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:30:09.047241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:30:09.047241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:30:09.047241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:30:09.047241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:30:09.047241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:30:09.047241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:30:09.047241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:30:09.047241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. Sep 20 22:30:09.047241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:30:09.047241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-76623c6b-8c0b-48e6-8ebd-3c3d0553b199 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Returning 404 to user: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:30:09.047241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-76623c6b-8c0b-48e6-8ebd-3c3d0553b199 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/bde92b26-828a-4b5b-bf6b-099f701353ce" status: 404 len: 109 microversion: 2.1 time: 0.037514 Sep 20 22:30:09.047241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 386/798] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 20 22:30:09 2022] DELETE /compute/v2.1/os-volumes/bde92b26-828a-4b5b-bf6b-099f701353ce => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:30:09.056720 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-2f1f9101-d71a-470f-b5c0-b4717ca83f59 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Calling method '.version_select at 0x7f24f66e1a60>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:09.084776 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-2f1f9101-d71a-470f-b5c0-b4717ca83f59 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] HTTP exception thrown: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-2f1f9101-d71a-470f-b5c0-b4717ca83f59 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Request method failure captured: Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/os-volumes/bde92b26-828a-4b5b-bf6b-099f701353ce HTTP/1.1 Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj7pyDOxmHXAx2P5SmueRbjiHCj-0ww3Ks2MgCuY1TL73bAwjsGkwbqSUwCy0zcC9k_8G1woExI4-d_lEuWhZ1FuAglDJOiJDLBav80OwRuLi68DwFchmib1aeWDwH2KCwiMFlwJk6lpeM-VFPR0OEBuD__onMwcUl80lDQPkn74wvU Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: dd209174362648ee8e5a3699eb14509f Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-812089082 Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:30:09.086974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:30:09.088514 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd209174362648ee8e5a3699eb14509f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dd209174362648ee8e5a3699eb14509f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dd209174362648ee8e5a3699eb14509f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd209174362648ee8e5a3699eb14509f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:30:09.088514 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-VolumesSnapshotsTestJSON-812089082 Sep 20 22:30:09.088514 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: dd209174362648ee8e5a3699eb14509f Sep 20 22:30:09.088514 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-812089082 Sep 20 22:30:09.088514 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-VolumesSnapshotsTestJSON-812089082-project Sep 20 22:30:09.088514 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:30:09.088514 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:30:09.088514 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 90fb523044c74e3fbf4d08c182e32215 Sep 20 22:30:09.088514 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-VolumesSnapshotsTestJSON-812089082-project Sep 20 22:30:09.088514 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: Sep 20 22:30:09.088514 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. Sep 20 22:30:09.088514 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': 'bde92b26-828a-4b5b-bf6b-099f701353ce'} Sep 20 22:30:09.088514 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. (HTTP 404) (Request-ID: req-1c8202a4-6bf0-41e1-b7eb-9208ef879774) Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:30:09.089384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 20 22:30:09.090491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 20 22:30:09.091590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:30:09.092738 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. Sep 20 22:30:09.092738 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:30:09.092738 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:30:09.092738 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:30:09.092738 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:30:09.092738 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:30:09.092738 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:30:09.092738 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:30:09.092738 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:30:09.092738 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. Sep 20 22:30:09.092738 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:30:09.092738 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-2f1f9101-d71a-470f-b5c0-b4717ca83f59 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] Returning 404 to user: Volume bde92b26-828a-4b5b-bf6b-099f701353ce could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:30:09.092738 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-2f1f9101-d71a-470f-b5c0-b4717ca83f59 tempest-VolumesSnapshotsTestJSON-812089082 tempest-VolumesSnapshotsTestJSON-812089082-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/bde92b26-828a-4b5b-bf6b-099f701353ce" status: 404 len: 109 microversion: 2.1 time: 0.035431 Sep 20 22:30:09.092738 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 413/799] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 20 22:30:09 2022] GET /compute/v2.1/os-volumes/bde92b26-828a-4b5b-bf6b-099f701353ce => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:30:09.093723 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-daaa217c-3bd4-43fd-899f-8cdcb3a59809 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:30:09.093723 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-daaa217c-3bd4-43fd-899f-8cdcb3a59809 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:09.097441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-daaa217c-3bd4-43fd-899f-8cdcb3a59809 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:09.097869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-daaa217c-3bd4-43fd-899f-8cdcb3a59809 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:09.098310 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-daaa217c-3bd4-43fd-899f-8cdcb3a59809 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:09.099051 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-daaa217c-3bd4-43fd-899f-8cdcb3a59809 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:09.099564 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-daaa217c-3bd4-43fd-899f-8cdcb3a59809 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:09.099988 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-daaa217c-3bd4-43fd-899f-8cdcb3a59809 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:09.130819 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-daaa217c-3bd4-43fd-899f-8cdcb3a59809 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120473) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 20 22:30:09.205925 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-daaa217c-3bd4-43fd-899f-8cdcb3a59809 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "POST /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7/action" status: 202 len: 0 microversion: 2.20 time: 0.121038 Sep 20 22:30:09.207238 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 387/800] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Sep 20 22:30:09 2022] POST /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 20 22:30:09.219723 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5f375285-d6c4-4dae-995d-9ffaa7913227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:09.220354 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5f375285-d6c4-4dae-995d-9ffaa7913227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:09.236182 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5f375285-d6c4-4dae-995d-9ffaa7913227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:09.236883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5f375285-d6c4-4dae-995d-9ffaa7913227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:09.237818 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5f375285-d6c4-4dae-995d-9ffaa7913227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:09.238560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5f375285-d6c4-4dae-995d-9ffaa7913227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:09.239185 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5f375285-d6c4-4dae-995d-9ffaa7913227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:09.239612 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5f375285-d6c4-4dae-995d-9ffaa7913227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:09.243776 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6aada71e-6369-42a1-95fd-df13a6bf29aa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:09.245963 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-6aada71e-6369-42a1-95fd-df13a6bf29aa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:09.254853 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6aada71e-6369-42a1-95fd-df13a6bf29aa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:09.255404 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6aada71e-6369-42a1-95fd-df13a6bf29aa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:09.256027 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6aada71e-6369-42a1-95fd-df13a6bf29aa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:09.257102 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6aada71e-6369-42a1-95fd-df13a6bf29aa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:09.257723 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6aada71e-6369-42a1-95fd-df13a6bf29aa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:09.258158 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6aada71e-6369-42a1-95fd-df13a6bf29aa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:09.272163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:09.421163 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-6aada71e-6369-42a1-95fd-df13a6bf29aa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:09.432846 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-6aada71e-6369-42a1-95fd-df13a6bf29aa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1453 microversion: 2.1 time: 0.193778 Sep 20 22:30:09.449254 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-5f375285-d6c4-4dae-995d-9ffaa7913227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:09.456631 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-5f375285-d6c4-4dae-995d-9ffaa7913227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:09.456793 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-5f375285-d6c4-4dae-995d-9ffaa7913227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:09.458374 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 388/801] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:09 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1453 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:30:09.459307 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5f375285-d6c4-4dae-995d-9ffaa7913227 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1672 microversion: 2.20 time: 0.248123 Sep 20 22:30:09.460549 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 414/802] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:09 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1672 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:09.487704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-000841b4-2456-4235-8917-286e3b5966be tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:09.494467 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-000841b4-2456-4235-8917-286e3b5966be tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:09.512608 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-000841b4-2456-4235-8917-286e3b5966be tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:09.514846 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-000841b4-2456-4235-8917-286e3b5966be tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:09.516090 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-000841b4-2456-4235-8917-286e3b5966be tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:09.519881 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-000841b4-2456-4235-8917-286e3b5966be tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:09.520670 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-000841b4-2456-4235-8917-286e3b5966be tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:09.521367 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-000841b4-2456-4235-8917-286e3b5966be tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:09.785536 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-000841b4-2456-4235-8917-286e3b5966be tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:09.800068 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-000841b4-2456-4235-8917-286e3b5966be tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1453 microversion: 2.1 time: 0.334649 Sep 20 22:30:09.801069 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 389/803] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:09 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1453 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:10.489205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-49f22ae9-7076-44b2-8a83-fa7ec67d3092 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:10.490635 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-49f22ae9-7076-44b2-8a83-fa7ec67d3092 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:10.498034 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-49f22ae9-7076-44b2-8a83-fa7ec67d3092 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:10.498545 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-49f22ae9-7076-44b2-8a83-fa7ec67d3092 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:10.499158 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-49f22ae9-7076-44b2-8a83-fa7ec67d3092 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:10.500023 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-49f22ae9-7076-44b2-8a83-fa7ec67d3092 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:10.501004 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-49f22ae9-7076-44b2-8a83-fa7ec67d3092 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:10.501412 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-49f22ae9-7076-44b2-8a83-fa7ec67d3092 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:10.653783 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-49f22ae9-7076-44b2-8a83-fa7ec67d3092 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:10.663648 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-49f22ae9-7076-44b2-8a83-fa7ec67d3092 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:10.665206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-49f22ae9-7076-44b2-8a83-fa7ec67d3092 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:10.666407 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-49f22ae9-7076-44b2-8a83-fa7ec67d3092 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1672 microversion: 2.20 time: 0.181398 Sep 20 22:30:10.666964 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 415/804] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:10 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1672 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:11.677448 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-1a30e7f6-96a1-4d71-8d64-12f05bcc1239 req-9d3d23e8-64e2-46ac-8630-4f504e753241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822d0d2c-d682-4143-b1b3-7feeaf3636f7", "name": "network-vif-unplugged", "status": "completed", "tag": "d76e99ad-dedc-45dd-ba58-8632f5cb0aba"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:30:11.692302 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-d9fae4e1-d335-4051-b561-65a638e0a105 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:11.692907 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-d9fae4e1-d335-4051-b561-65a638e0a105 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:11.693215 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-1a30e7f6-96a1-4d71-8d64-12f05bcc1239 req-9d3d23e8-64e2-46ac-8630-4f504e753241 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:11.693920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-1a30e7f6-96a1-4d71-8d64-12f05bcc1239 req-9d3d23e8-64e2-46ac-8630-4f504e753241 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:11.694561 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-1a30e7f6-96a1-4d71-8d64-12f05bcc1239 req-9d3d23e8-64e2-46ac-8630-4f504e753241 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:11.703242 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d9fae4e1-d335-4051-b561-65a638e0a105 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:11.703775 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d9fae4e1-d335-4051-b561-65a638e0a105 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:11.704211 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d9fae4e1-d335-4051-b561-65a638e0a105 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:11.708440 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d9fae4e1-d335-4051-b561-65a638e0a105 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:11.709052 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d9fae4e1-d335-4051-b561-65a638e0a105 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:11.709499 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d9fae4e1-d335-4051-b561-65a638e0a105 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:11.711260 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.compute.server_external_events [req-1a30e7f6-96a1-4d71-8d64-12f05bcc1239 req-9d3d23e8-64e2-46ac-8630-4f504e753241 service nova] Unable to find a host for instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7. Dropping event network-vif-unplugged {{(pid=120473) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 20 22:30:11.712330 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-1a30e7f6-96a1-4d71-8d64-12f05bcc1239 req-9d3d23e8-64e2-46ac-8630-4f504e753241 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039890 Sep 20 22:30:11.713887 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 390/805] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 20 22:30:11.911965 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-d9fae4e1-d335-4051-b561-65a638e0a105 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:11.920734 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-d9fae4e1-d335-4051-b561-65a638e0a105 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:11.923108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-d9fae4e1-d335-4051-b561-65a638e0a105 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:11.924470 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-d9fae4e1-d335-4051-b561-65a638e0a105 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1674 microversion: 2.20 time: 0.236561 Sep 20 22:30:11.925133 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 416/806] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:11 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1674 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:30:11.955151 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-7877083d-8a11-486c-8b6a-f563a0eda604 req-85e14a06-c936-48d3-83ad-871f0391338f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1", "tag": "44f0fe4e-7638-4e2e-98e3-eff3ce9acfe4"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:30:11.964625 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-7877083d-8a11-486c-8b6a-f563a0eda604 req-85e14a06-c936-48d3-83ad-871f0391338f service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:11.965132 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-7877083d-8a11-486c-8b6a-f563a0eda604 req-85e14a06-c936-48d3-83ad-871f0391338f service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:11.965556 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-7877083d-8a11-486c-8b6a-f563a0eda604 req-85e14a06-c936-48d3-83ad-871f0391338f service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:11.976355 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-7877083d-8a11-486c-8b6a-f563a0eda604 req-85e14a06-c936-48d3-83ad-871f0391338f service nova] Creating event network-changed:44f0fe4e-7638-4e2e-98e3-eff3ce9acfe4 for instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 on hv-cinder-85827 Sep 20 22:30:11.981599 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-7877083d-8a11-486c-8b6a-f563a0eda604 req-85e14a06-c936-48d3-83ad-871f0391338f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030134 Sep 20 22:30:11.982179 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 391/807] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:30:12.950027 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4a950734-7585-4f9a-928a-ff1b278425b4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:12.959268 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4a950734-7585-4f9a-928a-ff1b278425b4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:12.990331 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4a950734-7585-4f9a-928a-ff1b278425b4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:12.992249 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4a950734-7585-4f9a-928a-ff1b278425b4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:12.993147 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4a950734-7585-4f9a-928a-ff1b278425b4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:12.995326 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4a950734-7585-4f9a-928a-ff1b278425b4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:12.996834 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4a950734-7585-4f9a-928a-ff1b278425b4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:13.002825 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4a950734-7585-4f9a-928a-ff1b278425b4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:13.442995 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4a950734-7585-4f9a-928a-ff1b278425b4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:13.451295 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4a950734-7585-4f9a-928a-ff1b278425b4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:13.455468 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4a950734-7585-4f9a-928a-ff1b278425b4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:13.459679 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4a950734-7585-4f9a-928a-ff1b278425b4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1730 microversion: 2.20 time: 0.513663 Sep 20 22:30:13.460355 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 417/808] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:12 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1730 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:14.490788 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-56b3e48e-10a5-419e-97cb-80cc065e2551 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:14.491779 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-56b3e48e-10a5-419e-97cb-80cc065e2551 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:14.507879 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56b3e48e-10a5-419e-97cb-80cc065e2551 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:14.508379 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56b3e48e-10a5-419e-97cb-80cc065e2551 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:14.508918 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56b3e48e-10a5-419e-97cb-80cc065e2551 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:14.509552 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56b3e48e-10a5-419e-97cb-80cc065e2551 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:14.510774 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56b3e48e-10a5-419e-97cb-80cc065e2551 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:14.511914 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-56b3e48e-10a5-419e-97cb-80cc065e2551 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:14.690914 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-56b3e48e-10a5-419e-97cb-80cc065e2551 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:14.702454 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-56b3e48e-10a5-419e-97cb-80cc065e2551 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:14.704317 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-56b3e48e-10a5-419e-97cb-80cc065e2551 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:14.706075 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-56b3e48e-10a5-419e-97cb-80cc065e2551 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1730 microversion: 2.20 time: 0.222238 Sep 20 22:30:14.721890 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 392/809] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:14 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:15.734534 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-53ce5de2-d73a-43bd-b0b7-fce36444526d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:15.735775 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-53ce5de2-d73a-43bd-b0b7-fce36444526d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:15.742267 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-53ce5de2-d73a-43bd-b0b7-fce36444526d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:15.742989 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-53ce5de2-d73a-43bd-b0b7-fce36444526d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:15.743441 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-53ce5de2-d73a-43bd-b0b7-fce36444526d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:15.744117 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-53ce5de2-d73a-43bd-b0b7-fce36444526d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:15.744566 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-53ce5de2-d73a-43bd-b0b7-fce36444526d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:15.745001 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-53ce5de2-d73a-43bd-b0b7-fce36444526d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:15.890117 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-53ce5de2-d73a-43bd-b0b7-fce36444526d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:15.898328 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-53ce5de2-d73a-43bd-b0b7-fce36444526d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:15.899936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-53ce5de2-d73a-43bd-b0b7-fce36444526d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:15.901135 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-53ce5de2-d73a-43bd-b0b7-fce36444526d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1730 microversion: 2.20 time: 0.170484 Sep 20 22:30:15.901686 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 418/810] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:15 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:16.927576 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8a1457b9-da67-4de5-bd3c-e1fb0ecc525f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:16.928947 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8a1457b9-da67-4de5-bd3c-e1fb0ecc525f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:16.936051 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8a1457b9-da67-4de5-bd3c-e1fb0ecc525f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:16.936530 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8a1457b9-da67-4de5-bd3c-e1fb0ecc525f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:16.936959 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8a1457b9-da67-4de5-bd3c-e1fb0ecc525f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:16.937770 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8a1457b9-da67-4de5-bd3c-e1fb0ecc525f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:16.938852 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8a1457b9-da67-4de5-bd3c-e1fb0ecc525f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:16.939269 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8a1457b9-da67-4de5-bd3c-e1fb0ecc525f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:17.095881 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-8a1457b9-da67-4de5-bd3c-e1fb0ecc525f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:17.103888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-8a1457b9-da67-4de5-bd3c-e1fb0ecc525f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:17.105402 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-8a1457b9-da67-4de5-bd3c-e1fb0ecc525f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:17.106548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-8a1457b9-da67-4de5-bd3c-e1fb0ecc525f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1730 microversion: 2.20 time: 0.183111 Sep 20 22:30:17.107104 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 393/811] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:16 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:18.143069 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-327fa2c0-4e37-4c4e-b6b7-503cf03c8c3b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:18.143631 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-327fa2c0-4e37-4c4e-b6b7-503cf03c8c3b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:18.159159 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-327fa2c0-4e37-4c4e-b6b7-503cf03c8c3b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:18.159989 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-327fa2c0-4e37-4c4e-b6b7-503cf03c8c3b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:18.160457 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-327fa2c0-4e37-4c4e-b6b7-503cf03c8c3b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:18.161442 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-327fa2c0-4e37-4c4e-b6b7-503cf03c8c3b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:18.162055 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-327fa2c0-4e37-4c4e-b6b7-503cf03c8c3b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:18.162801 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-327fa2c0-4e37-4c4e-b6b7-503cf03c8c3b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:18.303007 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-327fa2c0-4e37-4c4e-b6b7-503cf03c8c3b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:18.312889 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-327fa2c0-4e37-4c4e-b6b7-503cf03c8c3b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:18.314416 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-327fa2c0-4e37-4c4e-b6b7-503cf03c8c3b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:18.315655 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-327fa2c0-4e37-4c4e-b6b7-503cf03c8c3b tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1730 microversion: 2.20 time: 0.183110 Sep 20 22:30:18.316211 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 419/812] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:18 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:19.342372 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c4e35386-b51b-4767-90d9-27252e7e63ba tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:19.343057 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c4e35386-b51b-4767-90d9-27252e7e63ba tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:19.352017 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c4e35386-b51b-4767-90d9-27252e7e63ba tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:19.352503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c4e35386-b51b-4767-90d9-27252e7e63ba tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:19.352942 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c4e35386-b51b-4767-90d9-27252e7e63ba tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:19.353770 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c4e35386-b51b-4767-90d9-27252e7e63ba tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:19.354222 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c4e35386-b51b-4767-90d9-27252e7e63ba tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:19.354699 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c4e35386-b51b-4767-90d9-27252e7e63ba tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:19.497942 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c4e35386-b51b-4767-90d9-27252e7e63ba tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:19.507028 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c4e35386-b51b-4767-90d9-27252e7e63ba tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:19.508580 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c4e35386-b51b-4767-90d9-27252e7e63ba tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:19.509886 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-c4e35386-b51b-4767-90d9-27252e7e63ba tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1730 microversion: 2.20 time: 0.171730 Sep 20 22:30:19.513100 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 394/813] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:19 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:30:20.535851 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b82a28af-4fe6-4422-bf6e-577f6b3b150e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:20.536502 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b82a28af-4fe6-4422-bf6e-577f6b3b150e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:20.544672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b82a28af-4fe6-4422-bf6e-577f6b3b150e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:20.545358 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b82a28af-4fe6-4422-bf6e-577f6b3b150e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:20.546159 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b82a28af-4fe6-4422-bf6e-577f6b3b150e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:20.547321 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b82a28af-4fe6-4422-bf6e-577f6b3b150e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:20.548215 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b82a28af-4fe6-4422-bf6e-577f6b3b150e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:20.548855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b82a28af-4fe6-4422-bf6e-577f6b3b150e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:20.748379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b82a28af-4fe6-4422-bf6e-577f6b3b150e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:20.770877 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b82a28af-4fe6-4422-bf6e-577f6b3b150e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:20.773653 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b82a28af-4fe6-4422-bf6e-577f6b3b150e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:20.775613 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b82a28af-4fe6-4422-bf6e-577f6b3b150e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1730 microversion: 2.20 time: 0.244600 Sep 20 22:30:20.777860 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 420/814] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:20 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1730 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 20 22:30:21.815176 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b9a3ddfb-cbaa-46e7-9951-5e7ccfc99bfa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:21.816545 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b9a3ddfb-cbaa-46e7-9951-5e7ccfc99bfa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:21.826062 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b9a3ddfb-cbaa-46e7-9951-5e7ccfc99bfa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:21.827758 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b9a3ddfb-cbaa-46e7-9951-5e7ccfc99bfa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:21.828413 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b9a3ddfb-cbaa-46e7-9951-5e7ccfc99bfa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:21.829801 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b9a3ddfb-cbaa-46e7-9951-5e7ccfc99bfa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:21.830649 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b9a3ddfb-cbaa-46e7-9951-5e7ccfc99bfa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:21.831288 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b9a3ddfb-cbaa-46e7-9951-5e7ccfc99bfa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:22.022141 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b9a3ddfb-cbaa-46e7-9951-5e7ccfc99bfa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:22.031523 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b9a3ddfb-cbaa-46e7-9951-5e7ccfc99bfa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:22.033171 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b9a3ddfb-cbaa-46e7-9951-5e7ccfc99bfa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:22.034508 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b9a3ddfb-cbaa-46e7-9951-5e7ccfc99bfa tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1730 microversion: 2.20 time: 0.228932 Sep 20 22:30:22.035252 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 395/815] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:21 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:23.062454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f3eac6fe-7ee8-45c3-8dee-c76af0014b12 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:23.064718 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-f3eac6fe-7ee8-45c3-8dee-c76af0014b12 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:23.068125 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=52 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:23.088894 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f3eac6fe-7ee8-45c3-8dee-c76af0014b12 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:23.094644 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f3eac6fe-7ee8-45c3-8dee-c76af0014b12 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:23.095224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f3eac6fe-7ee8-45c3-8dee-c76af0014b12 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:23.096345 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f3eac6fe-7ee8-45c3-8dee-c76af0014b12 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:23.096992 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f3eac6fe-7ee8-45c3-8dee-c76af0014b12 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:23.097558 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f3eac6fe-7ee8-45c3-8dee-c76af0014b12 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:23.478239 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-f3eac6fe-7ee8-45c3-8dee-c76af0014b12 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:23.487812 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-f3eac6fe-7ee8-45c3-8dee-c76af0014b12 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:23.489313 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-f3eac6fe-7ee8-45c3-8dee-c76af0014b12 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:23.490490 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-f3eac6fe-7ee8-45c3-8dee-c76af0014b12 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1730 microversion: 2.20 time: 0.433978 Sep 20 22:30:23.503241 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 421/816] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:23 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1730 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:24.527311 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-49f4ed13-67e3-4923-bdaf-b6d58ef3fa36 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:24.527913 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-49f4ed13-67e3-4923-bdaf-b6d58ef3fa36 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:24.530839 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:24.537507 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-49f4ed13-67e3-4923-bdaf-b6d58ef3fa36 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:24.537999 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-49f4ed13-67e3-4923-bdaf-b6d58ef3fa36 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:24.538433 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-49f4ed13-67e3-4923-bdaf-b6d58ef3fa36 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:24.539136 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-49f4ed13-67e3-4923-bdaf-b6d58ef3fa36 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:24.539611 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-49f4ed13-67e3-4923-bdaf-b6d58ef3fa36 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:24.540030 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-49f4ed13-67e3-4923-bdaf-b6d58ef3fa36 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:24.557150 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:24.697606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-49f4ed13-67e3-4923-bdaf-b6d58ef3fa36 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:24.706041 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-49f4ed13-67e3-4923-bdaf-b6d58ef3fa36 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:24.708156 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-49f4ed13-67e3-4923-bdaf-b6d58ef3fa36 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:24.710206 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-49f4ed13-67e3-4923-bdaf-b6d58ef3fa36 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1730 microversion: 2.20 time: 0.186795 Sep 20 22:30:24.714643 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 396/817] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:24 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:25.738381 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-be062563-6bb8-4902-a321-7cf2888a5e2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:25.739500 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-be062563-6bb8-4902-a321-7cf2888a5e2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:25.746121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-be062563-6bb8-4902-a321-7cf2888a5e2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:25.746867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-be062563-6bb8-4902-a321-7cf2888a5e2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:25.747309 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-be062563-6bb8-4902-a321-7cf2888a5e2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:25.748104 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-be062563-6bb8-4902-a321-7cf2888a5e2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:25.748566 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-be062563-6bb8-4902-a321-7cf2888a5e2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:25.749369 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-be062563-6bb8-4902-a321-7cf2888a5e2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:25.937629 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-be062563-6bb8-4902-a321-7cf2888a5e2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:25.947203 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-be062563-6bb8-4902-a321-7cf2888a5e2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:25.948736 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-be062563-6bb8-4902-a321-7cf2888a5e2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:25.949994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-be062563-6bb8-4902-a321-7cf2888a5e2c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1730 microversion: 2.20 time: 0.216821 Sep 20 22:30:25.950625 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 422/818] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:25 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1730 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:26.976732 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-dcb46b56-8876-4770-a53f-fb38d7b95d06 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:26.977287 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-dcb46b56-8876-4770-a53f-fb38d7b95d06 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:26.985939 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dcb46b56-8876-4770-a53f-fb38d7b95d06 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:26.990165 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dcb46b56-8876-4770-a53f-fb38d7b95d06 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:26.994397 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dcb46b56-8876-4770-a53f-fb38d7b95d06 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:26.995358 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dcb46b56-8876-4770-a53f-fb38d7b95d06 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:26.999536 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dcb46b56-8876-4770-a53f-fb38d7b95d06 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:27.000190 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-dcb46b56-8876-4770-a53f-fb38d7b95d06 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:27.153509 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-dcb46b56-8876-4770-a53f-fb38d7b95d06 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:27.163004 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-dcb46b56-8876-4770-a53f-fb38d7b95d06 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:27.164801 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-dcb46b56-8876-4770-a53f-fb38d7b95d06 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:27.166192 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-dcb46b56-8876-4770-a53f-fb38d7b95d06 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1730 microversion: 2.20 time: 0.193539 Sep 20 22:30:27.166938 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 397/819] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:26 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:28.193798 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a910a6ba-2023-4946-9956-e4d9788f87e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:28.194959 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a910a6ba-2023-4946-9956-e4d9788f87e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:28.201771 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a910a6ba-2023-4946-9956-e4d9788f87e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:28.202470 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a910a6ba-2023-4946-9956-e4d9788f87e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:28.203107 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a910a6ba-2023-4946-9956-e4d9788f87e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:28.203813 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a910a6ba-2023-4946-9956-e4d9788f87e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:28.204272 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a910a6ba-2023-4946-9956-e4d9788f87e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:28.204693 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a910a6ba-2023-4946-9956-e4d9788f87e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:28.465079 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a910a6ba-2023-4946-9956-e4d9788f87e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:28.474400 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a910a6ba-2023-4946-9956-e4d9788f87e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:28.476036 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a910a6ba-2023-4946-9956-e4d9788f87e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:28.477226 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a910a6ba-2023-4946-9956-e4d9788f87e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1730 microversion: 2.20 time: 0.287369 Sep 20 22:30:28.491866 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 423/820] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:28 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1730 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:29.319430 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-6eccf13d-f0a5-4cb4-be17-38af23ba4710 req-f2682c57-616f-4129-8c84-86b71a1d2f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822d0d2c-d682-4143-b1b3-7feeaf3636f7", "name": "network-vif-plugged", "status": "completed", "tag": "d76e99ad-dedc-45dd-ba58-8632f5cb0aba"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:30:29.332332 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-6eccf13d-f0a5-4cb4-be17-38af23ba4710 req-f2682c57-616f-4129-8c84-86b71a1d2f2a service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:29.333113 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-6eccf13d-f0a5-4cb4-be17-38af23ba4710 req-f2682c57-616f-4129-8c84-86b71a1d2f2a service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:29.333625 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-6eccf13d-f0a5-4cb4-be17-38af23ba4710 req-f2682c57-616f-4129-8c84-86b71a1d2f2a service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:29.346670 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-6eccf13d-f0a5-4cb4-be17-38af23ba4710 req-f2682c57-616f-4129-8c84-86b71a1d2f2a service nova] Creating event network-vif-plugged:d76e99ad-dedc-45dd-ba58-8632f5cb0aba for instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 on hv-cinder-85827 Sep 20 22:30:29.352811 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-6eccf13d-f0a5-4cb4-be17-38af23ba4710 req-f2682c57-616f-4129-8c84-86b71a1d2f2a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040439 Sep 20 22:30:29.354451 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 398/821] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:30:29.504074 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3fe07adf-8679-40d7-bae2-67a20c36d5f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:29.505426 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-3fe07adf-8679-40d7-bae2-67a20c36d5f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:29.512220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3fe07adf-8679-40d7-bae2-67a20c36d5f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:29.513053 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3fe07adf-8679-40d7-bae2-67a20c36d5f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:29.513726 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3fe07adf-8679-40d7-bae2-67a20c36d5f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:29.514641 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3fe07adf-8679-40d7-bae2-67a20c36d5f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:29.515305 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3fe07adf-8679-40d7-bae2-67a20c36d5f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:29.516766 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3fe07adf-8679-40d7-bae2-67a20c36d5f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:29.829917 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3fe07adf-8679-40d7-bae2-67a20c36d5f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:29.839839 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3fe07adf-8679-40d7-bae2-67a20c36d5f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:29.841468 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3fe07adf-8679-40d7-bae2-67a20c36d5f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:29.843114 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-3fe07adf-8679-40d7-bae2-67a20c36d5f7 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1730 microversion: 2.20 time: 0.343043 Sep 20 22:30:29.843938 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 424/822] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:29 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1730 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:30.881374 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8d263185-699a-4aff-979c-fcd6f00597b8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:30.883554 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8d263185-699a-4aff-979c-fcd6f00597b8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:30.891656 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8d263185-699a-4aff-979c-fcd6f00597b8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:30.892331 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8d263185-699a-4aff-979c-fcd6f00597b8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:30.892935 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8d263185-699a-4aff-979c-fcd6f00597b8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:30.894042 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8d263185-699a-4aff-979c-fcd6f00597b8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:30.894800 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8d263185-699a-4aff-979c-fcd6f00597b8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:30.895385 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8d263185-699a-4aff-979c-fcd6f00597b8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:31.298843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-8d263185-699a-4aff-979c-fcd6f00597b8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:31.307675 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-8d263185-699a-4aff-979c-fcd6f00597b8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:31.316660 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-8d263185-699a-4aff-979c-fcd6f00597b8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:31.316660 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-8d263185-699a-4aff-979c-fcd6f00597b8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1730 microversion: 2.20 time: 0.445299 Sep 20 22:30:31.316933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 399/823] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:30 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1730 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:32.346276 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f654c0cb-b5f7-4801-82fb-55d481f38065 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:32.348795 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-f654c0cb-b5f7-4801-82fb-55d481f38065 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:32.365063 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f654c0cb-b5f7-4801-82fb-55d481f38065 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:32.368265 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f654c0cb-b5f7-4801-82fb-55d481f38065 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:32.370200 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f654c0cb-b5f7-4801-82fb-55d481f38065 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:32.374089 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f654c0cb-b5f7-4801-82fb-55d481f38065 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:32.388662 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f654c0cb-b5f7-4801-82fb-55d481f38065 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:32.389265 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f654c0cb-b5f7-4801-82fb-55d481f38065 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:32.769306 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-f654c0cb-b5f7-4801-82fb-55d481f38065 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:32.785944 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-f654c0cb-b5f7-4801-82fb-55d481f38065 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:32.788005 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-f654c0cb-b5f7-4801-82fb-55d481f38065 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:32.789604 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-f654c0cb-b5f7-4801-82fb-55d481f38065 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1730 microversion: 2.20 time: 0.449688 Sep 20 22:30:32.790879 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 425/824] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:32 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1730 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:33.819252 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-5e7d695d-aec7-4f6d-ba5e-f3ad196bd945 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:33.822166 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-5e7d695d-aec7-4f6d-ba5e-f3ad196bd945 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:33.831702 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5e7d695d-aec7-4f6d-ba5e-f3ad196bd945 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:33.832572 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5e7d695d-aec7-4f6d-ba5e-f3ad196bd945 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:33.833519 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5e7d695d-aec7-4f6d-ba5e-f3ad196bd945 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:33.834464 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5e7d695d-aec7-4f6d-ba5e-f3ad196bd945 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:33.835137 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5e7d695d-aec7-4f6d-ba5e-f3ad196bd945 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:33.835796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5e7d695d-aec7-4f6d-ba5e-f3ad196bd945 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:34.024580 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-5e7d695d-aec7-4f6d-ba5e-f3ad196bd945 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:34.032843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-5e7d695d-aec7-4f6d-ba5e-f3ad196bd945 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:34.034314 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-5e7d695d-aec7-4f6d-ba5e-f3ad196bd945 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:34.035458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-5e7d695d-aec7-4f6d-ba5e-f3ad196bd945 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1717 microversion: 2.20 time: 0.221119 Sep 20 22:30:34.036008 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 400/825] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:30:33 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1717 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:30:43.627781 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=9 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:43.629099 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=68 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:43.633997 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-e57b584f-2282-4bd6-a4e2-51aa4f947491 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Action: 'create', calling method: .version_select at 0x7f24f66801f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-956717486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCp7kWhig7rNMCRVEiLO5bhyzPSzyWeL2nsNV4EL5zpsV7Tfo1N7rsEYJRsbfrkmo6l6ue2RCH0YzNmSwUlC7U2tQSiO4CRyEc+IR2t7/jrJnh/a2UPoaBlkHCvnSLyIQ=="}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:30:43.652712 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-e57b584f-2282-4bd6-a4e2-51aa4f947491 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Getting quotas for project 021bf48fb20347f8bb6664c066b2c93f. Resources: {'key_pairs'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:30:43.657575 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-e57b584f-2282-4bd6-a4e2-51aa4f947491 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Getting quotas for user fd496dcf230b4cd5b5eb514103c55005 and project 021bf48fb20347f8bb6664c066b2c93f. Resources: {'key_pairs'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:30:43.680472 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-e57b584f-2282-4bd6-a4e2-51aa4f947491 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053823 Sep 20 22:30:43.681108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 426/826] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 20 22:30:43 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:30:43.731112 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-e2baab20-9e47-4999-a376-f453507c0c3d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1634273803", "imageRef": "c63a9311-baae-4280-ac1b-ae4217dfd396", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-956717486", "networks": [{"uuid": "5cc1250a-5c5f-438e-89a3-e60caaf00585"}]}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:30:43.791110 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.network.neutron [None req-e2baab20-9e47-4999-a376-f453507c0c3d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] validate_networks() for [('5cc1250a-5c5f-438e-89a3-e60caaf00585', None, None, None, None, None)] {{(pid=120473) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:30:44.029630 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=23 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:44.850933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-e2baab20-9e47-4999-a376-f453507c0c3d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Flavor limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:30:44.851574 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-e2baab20-9e47-4999-a376-f453507c0c3d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Image limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:30:44.851810 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-e2baab20-9e47-4999-a376-f453507c0c3d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Flavor pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:30:44.852332 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-e2baab20-9e47-4999-a376-f453507c0c3d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Image pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:30:44.852736 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-e2baab20-9e47-4999-a376-f453507c0c3d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:30:44.863125 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e2baab20-9e47-4999-a376-f453507c0c3d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:44.863491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e2baab20-9e47-4999-a376-f453507c0c3d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:44.864314 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e2baab20-9e47-4999-a376-f453507c0c3d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:44.865382 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e2baab20-9e47-4999-a376-f453507c0c3d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:44.866274 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e2baab20-9e47-4999-a376-f453507c0c3d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:44.866705 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e2baab20-9e47-4999-a376-f453507c0c3d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:44.886319 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-e2baab20-9e47-4999-a376-f453507c0c3d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Getting quotas for project 021bf48fb20347f8bb6664c066b2c93f. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:30:44.890936 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-e2baab20-9e47-4999-a376-f453507c0c3d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Getting quotas for user fd496dcf230b4cd5b5eb514103c55005 and project 021bf48fb20347f8bb6664c066b2c93f. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:30:44.902705 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-e2baab20-9e47-4999-a376-f453507c0c3d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Going to run 1 instances... {{(pid=120473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:30:44.904994 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-e2baab20-9e47-4999-a376-f453507c0c3d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c63a9311-baae-4280-ac1b-ae4217dfd396',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:30:44.941229 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-fd117cb5-86a9-441b-bf01-d7456fc5b309 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:44.942519 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-fd117cb5-86a9-441b-bf01-d7456fc5b309 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:44.950448 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fd117cb5-86a9-441b-bf01-d7456fc5b309 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:44.951148 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fd117cb5-86a9-441b-bf01-d7456fc5b309 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:44.951868 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fd117cb5-86a9-441b-bf01-d7456fc5b309 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:44.952932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fd117cb5-86a9-441b-bf01-d7456fc5b309 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:44.953644 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fd117cb5-86a9-441b-bf01-d7456fc5b309 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:44.954115 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fd117cb5-86a9-441b-bf01-d7456fc5b309 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:44.980779 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-fd117cb5-86a9-441b-bf01-d7456fc5b309 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Going to try to terminate instance {{(pid=120474) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:30:44.985882 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-e2baab20-9e47-4999-a376-f453507c0c3d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.258535 Sep 20 22:30:44.987189 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 401/827] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:30:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 22:30:45.005683 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-f70067ad-32f2-4341-99d4-1446f24202d9 req-afb30c3a-1d5c-4c13-b2c6-7db64ae5f5ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a507bbd4-a0a2-4ca8-b04a-1511797060be", "tag": "87454e86-c277-4775-8223-737852068e10"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:30:45.043613 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-f70067ad-32f2-4341-99d4-1446f24202d9 req-afb30c3a-1d5c-4c13-b2c6-7db64ae5f5ef service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:45.044422 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-f70067ad-32f2-4341-99d4-1446f24202d9 req-afb30c3a-1d5c-4c13-b2c6-7db64ae5f5ef service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:45.045047 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-f70067ad-32f2-4341-99d4-1446f24202d9 req-afb30c3a-1d5c-4c13-b2c6-7db64ae5f5ef service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:45.057159 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-f70067ad-32f2-4341-99d4-1446f24202d9 req-afb30c3a-1d5c-4c13-b2c6-7db64ae5f5ef service nova] Creating event network-changed:87454e86-c277-4775-8223-737852068e10 for instance a507bbd4-a0a2-4ca8-b04a-1511797060be on hv-cinder-85827 Sep 20 22:30:45.066384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-f70067ad-32f2-4341-99d4-1446f24202d9 req-afb30c3a-1d5c-4c13-b2c6-7db64ae5f5ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077783 Sep 20 22:30:45.066976 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 402/828] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:30:45.078175 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-926584a4-4702-44bd-bf50-4d50ea014805 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:45.082405 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-926584a4-4702-44bd-bf50-4d50ea014805 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:45.116686 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-fd117cb5-86a9-441b-bf01-d7456fc5b309 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 204 len: 0 microversion: 2.1 time: 0.184730 Sep 20 22:30:45.117541 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 427/829] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:30:44 2022] DELETE /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:30:45.134651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a3597166-8d66-44d0-85bb-40811a9019cf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:45.135613 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a3597166-8d66-44d0-85bb-40811a9019cf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:45.144455 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a3597166-8d66-44d0-85bb-40811a9019cf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:45.144997 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a3597166-8d66-44d0-85bb-40811a9019cf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:45.146425 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a3597166-8d66-44d0-85bb-40811a9019cf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:45.150021 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a3597166-8d66-44d0-85bb-40811a9019cf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:45.157919 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a3597166-8d66-44d0-85bb-40811a9019cf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:45.161491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a3597166-8d66-44d0-85bb-40811a9019cf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:45.169821 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-926584a4-4702-44bd-bf50-4d50ea014805 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:45.198035 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-926584a4-4702-44bd-bf50-4d50ea014805 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1258 microversion: 2.1 time: 0.129645 Sep 20 22:30:45.199045 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 403/830] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:45 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1258 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:45.368160 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a3597166-8d66-44d0-85bb-40811a9019cf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:45.377638 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a3597166-8d66-44d0-85bb-40811a9019cf tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.247417 Sep 20 22:30:45.389366 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 428/831] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:45 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:46.225803 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0bedf0e8-f7b4-493b-becd-ca1517d99e31 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:46.226465 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-0bedf0e8-f7b4-493b-becd-ca1517d99e31 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:46.234523 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0bedf0e8-f7b4-493b-becd-ca1517d99e31 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:46.235007 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0bedf0e8-f7b4-493b-becd-ca1517d99e31 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:46.235440 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0bedf0e8-f7b4-493b-becd-ca1517d99e31 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:46.236525 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0bedf0e8-f7b4-493b-becd-ca1517d99e31 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:46.236999 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0bedf0e8-f7b4-493b-becd-ca1517d99e31 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:46.237431 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0bedf0e8-f7b4-493b-becd-ca1517d99e31 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:46.295878 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-0bedf0e8-f7b4-493b-becd-ca1517d99e31 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:46.303383 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-0bedf0e8-f7b4-493b-becd-ca1517d99e31 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1262 microversion: 2.1 time: 0.081507 Sep 20 22:30:46.303943 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 404/832] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:46 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:46.400770 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-e44b5b96-77a5-487c-bee0-eacf88a25421 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:46.401853 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-e44b5b96-77a5-487c-bee0-eacf88a25421 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:46.408375 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e44b5b96-77a5-487c-bee0-eacf88a25421 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:46.408857 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e44b5b96-77a5-487c-bee0-eacf88a25421 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:46.410344 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e44b5b96-77a5-487c-bee0-eacf88a25421 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:46.411173 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e44b5b96-77a5-487c-bee0-eacf88a25421 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:46.411636 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e44b5b96-77a5-487c-bee0-eacf88a25421 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:46.412062 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e44b5b96-77a5-487c-bee0-eacf88a25421 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:46.547638 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-e44b5b96-77a5-487c-bee0-eacf88a25421 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:46.555543 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-e44b5b96-77a5-487c-bee0-eacf88a25421 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.158788 Sep 20 22:30:46.556106 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 429/833] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:46 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:47.325758 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-32ce95a1-dafa-4149-8f4e-76fdbe5dd6b9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:47.326416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-32ce95a1-dafa-4149-8f4e-76fdbe5dd6b9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:47.333808 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32ce95a1-dafa-4149-8f4e-76fdbe5dd6b9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:47.334287 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32ce95a1-dafa-4149-8f4e-76fdbe5dd6b9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:47.334721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32ce95a1-dafa-4149-8f4e-76fdbe5dd6b9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:47.335419 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32ce95a1-dafa-4149-8f4e-76fdbe5dd6b9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:47.335861 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32ce95a1-dafa-4149-8f4e-76fdbe5dd6b9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:47.336287 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32ce95a1-dafa-4149-8f4e-76fdbe5dd6b9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:47.400221 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-32ce95a1-dafa-4149-8f4e-76fdbe5dd6b9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:47.407853 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-32ce95a1-dafa-4149-8f4e-76fdbe5dd6b9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1262 microversion: 2.1 time: 0.086051 Sep 20 22:30:47.408412 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 405/834] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:47 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:47.578161 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9d91ab5f-80d7-4bb0-b97d-66d88f8c2f2d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:47.578693 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9d91ab5f-80d7-4bb0-b97d-66d88f8c2f2d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:47.585127 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9d91ab5f-80d7-4bb0-b97d-66d88f8c2f2d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:47.585879 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9d91ab5f-80d7-4bb0-b97d-66d88f8c2f2d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:47.586321 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9d91ab5f-80d7-4bb0-b97d-66d88f8c2f2d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:47.587007 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9d91ab5f-80d7-4bb0-b97d-66d88f8c2f2d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:47.587459 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9d91ab5f-80d7-4bb0-b97d-66d88f8c2f2d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:47.587884 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9d91ab5f-80d7-4bb0-b97d-66d88f8c2f2d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:47.724162 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-9d91ab5f-80d7-4bb0-b97d-66d88f8c2f2d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:47.732170 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-9d91ab5f-80d7-4bb0-b97d-66d88f8c2f2d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.157968 Sep 20 22:30:47.732739 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 430/835] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:47 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:30:48.430676 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d5e08d97-8994-4490-90fc-02554260c00b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:48.431277 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d5e08d97-8994-4490-90fc-02554260c00b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:48.438204 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d5e08d97-8994-4490-90fc-02554260c00b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:48.438679 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d5e08d97-8994-4490-90fc-02554260c00b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:48.439137 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d5e08d97-8994-4490-90fc-02554260c00b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:48.439815 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d5e08d97-8994-4490-90fc-02554260c00b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:48.440259 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d5e08d97-8994-4490-90fc-02554260c00b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:48.440680 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d5e08d97-8994-4490-90fc-02554260c00b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:48.499655 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-d5e08d97-8994-4490-90fc-02554260c00b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:48.507097 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-d5e08d97-8994-4490-90fc-02554260c00b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1262 microversion: 2.1 time: 0.080240 Sep 20 22:30:48.507655 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 406/836] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:48 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:30:48.756230 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-aeab834f-7b87-43a7-ad17-9c45b452c98c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:48.756755 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-aeab834f-7b87-43a7-ad17-9c45b452c98c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:48.763177 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-aeab834f-7b87-43a7-ad17-9c45b452c98c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:48.763658 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-aeab834f-7b87-43a7-ad17-9c45b452c98c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:48.764091 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-aeab834f-7b87-43a7-ad17-9c45b452c98c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:48.764773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-aeab834f-7b87-43a7-ad17-9c45b452c98c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:48.765249 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-aeab834f-7b87-43a7-ad17-9c45b452c98c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:48.765671 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-aeab834f-7b87-43a7-ad17-9c45b452c98c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:48.974483 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-aeab834f-7b87-43a7-ad17-9c45b452c98c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:48.982778 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-aeab834f-7b87-43a7-ad17-9c45b452c98c tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1569 microversion: 2.1 time: 0.230490 Sep 20 22:30:48.983348 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 431/837] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:48 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:49.529612 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-06ce259f-b78b-4e1c-a0b0-ced9ee167d56 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:49.530223 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-06ce259f-b78b-4e1c-a0b0-ced9ee167d56 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:49.537651 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-06ce259f-b78b-4e1c-a0b0-ced9ee167d56 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:49.538228 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-06ce259f-b78b-4e1c-a0b0-ced9ee167d56 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:49.538764 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-06ce259f-b78b-4e1c-a0b0-ced9ee167d56 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:49.539555 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-06ce259f-b78b-4e1c-a0b0-ced9ee167d56 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:49.540108 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-06ce259f-b78b-4e1c-a0b0-ced9ee167d56 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:49.540621 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-06ce259f-b78b-4e1c-a0b0-ced9ee167d56 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:49.634797 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-06ce259f-b78b-4e1c-a0b0-ced9ee167d56 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:49.642966 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-06ce259f-b78b-4e1c-a0b0-ced9ee167d56 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1310 microversion: 2.1 time: 0.117433 Sep 20 22:30:49.643535 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 407/838] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:49 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1310 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:50.019667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-737aef12-1f73-44bd-9d27-78cb16a1597e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:50.020285 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-737aef12-1f73-44bd-9d27-78cb16a1597e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:50.034122 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-737aef12-1f73-44bd-9d27-78cb16a1597e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:50.035652 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-737aef12-1f73-44bd-9d27-78cb16a1597e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:50.036259 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-737aef12-1f73-44bd-9d27-78cb16a1597e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:50.037459 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-737aef12-1f73-44bd-9d27-78cb16a1597e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:50.039653 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-737aef12-1f73-44bd-9d27-78cb16a1597e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:50.040168 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-737aef12-1f73-44bd-9d27-78cb16a1597e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:50.072387 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-33dfdd2f-6f80-466f-965b-202122731381 req-f1e720c1-1288-434e-8c58-4c6a2a953004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a507bbd4-a0a2-4ca8-b04a-1511797060be", "name": "network-vif-deleted", "tag": "87454e86-c277-4775-8223-737852068e10"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:30:50.082671 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-33dfdd2f-6f80-466f-965b-202122731381 req-f1e720c1-1288-434e-8c58-4c6a2a953004 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:50.083310 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-33dfdd2f-6f80-466f-965b-202122731381 req-f1e720c1-1288-434e-8c58-4c6a2a953004 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:50.083747 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-33dfdd2f-6f80-466f-965b-202122731381 req-f1e720c1-1288-434e-8c58-4c6a2a953004 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:50.110047 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-33dfdd2f-6f80-466f-965b-202122731381 req-f1e720c1-1288-434e-8c58-4c6a2a953004 service nova] Creating event network-vif-deleted:87454e86-c277-4775-8223-737852068e10 for instance a507bbd4-a0a2-4ca8-b04a-1511797060be on hv-cinder-85827 Sep 20 22:30:50.115945 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-33dfdd2f-6f80-466f-965b-202122731381 req-f1e720c1-1288-434e-8c58-4c6a2a953004 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047280 Sep 20 22:30:50.116953 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 408/839] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:30:50.140726 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-737aef12-1f73-44bd-9d27-78cb16a1597e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:50.151300 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-737aef12-1f73-44bd-9d27-78cb16a1597e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1382 microversion: 2.1 time: 0.147199 Sep 20 22:30:50.154207 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 432/840] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:50 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1382 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:50.670573 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-9d93be0f-9812-4bb7-a563-0e639b39ac45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:50.673210 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-9d93be0f-9812-4bb7-a563-0e639b39ac45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:50.687753 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9d93be0f-9812-4bb7-a563-0e639b39ac45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:50.690890 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9d93be0f-9812-4bb7-a563-0e639b39ac45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:50.691500 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9d93be0f-9812-4bb7-a563-0e639b39ac45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:50.694160 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9d93be0f-9812-4bb7-a563-0e639b39ac45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:50.694687 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9d93be0f-9812-4bb7-a563-0e639b39ac45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:50.695287 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9d93be0f-9812-4bb7-a563-0e639b39ac45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:50.923888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-9d93be0f-9812-4bb7-a563-0e639b39ac45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:50.936194 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-9d93be0f-9812-4bb7-a563-0e639b39ac45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1358 microversion: 2.1 time: 0.273119 Sep 20 22:30:50.937028 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 409/841] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:50 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:51.179204 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-357b7e62-293b-4298-8260-b3718fbc9a0e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:51.180553 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-357b7e62-293b-4298-8260-b3718fbc9a0e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:51.194937 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-357b7e62-293b-4298-8260-b3718fbc9a0e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:51.196193 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-357b7e62-293b-4298-8260-b3718fbc9a0e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:51.200523 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-357b7e62-293b-4298-8260-b3718fbc9a0e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:51.201526 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-357b7e62-293b-4298-8260-b3718fbc9a0e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:51.202154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-357b7e62-293b-4298-8260-b3718fbc9a0e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:51.202921 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-357b7e62-293b-4298-8260-b3718fbc9a0e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:51.262405 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-357b7e62-293b-4298-8260-b3718fbc9a0e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:51.263270 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-357b7e62-293b-4298-8260-b3718fbc9a0e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:51.263712 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-357b7e62-293b-4298-8260-b3718fbc9a0e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:51.264424 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-357b7e62-293b-4298-8260-b3718fbc9a0e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lazy-loading 'fault' on Instance uuid a507bbd4-a0a2-4ca8-b04a-1511797060be {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:30:51.329342 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-357b7e62-293b-4298-8260-b3718fbc9a0e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:51.349379 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-357b7e62-293b-4298-8260-b3718fbc9a0e tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1224 microversion: 2.1 time: 0.174888 Sep 20 22:30:51.350000 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 433/842] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:51 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1224 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:51.888065 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-fdcc0140-11c6-4948-873f-2195478ab9a9 req-cf263d97-b62e-4324-968b-271f815df1bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c51ac84a-e21e-470f-b1c4-c542a1b8f553", "tag": "2c27dc78-c19b-4ad9-b5ae-35688f10f1a8"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:30:51.898333 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-fdcc0140-11c6-4948-873f-2195478ab9a9 req-cf263d97-b62e-4324-968b-271f815df1bf service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:51.898883 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-fdcc0140-11c6-4948-873f-2195478ab9a9 req-cf263d97-b62e-4324-968b-271f815df1bf service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:51.899316 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-fdcc0140-11c6-4948-873f-2195478ab9a9 req-cf263d97-b62e-4324-968b-271f815df1bf service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:51.910587 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-fdcc0140-11c6-4948-873f-2195478ab9a9 req-cf263d97-b62e-4324-968b-271f815df1bf service nova] Creating event network-changed:2c27dc78-c19b-4ad9-b5ae-35688f10f1a8 for instance c51ac84a-e21e-470f-b1c4-c542a1b8f553 on hv-cinder-85827 Sep 20 22:30:51.915307 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-fdcc0140-11c6-4948-873f-2195478ab9a9 req-cf263d97-b62e-4324-968b-271f815df1bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030944 Sep 20 22:30:51.915904 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 410/843] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:30:51.960668 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3d4971dd-5210-43c2-959d-db852bebafdf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:51.961306 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-3d4971dd-5210-43c2-959d-db852bebafdf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:51.968702 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3d4971dd-5210-43c2-959d-db852bebafdf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:51.969479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3d4971dd-5210-43c2-959d-db852bebafdf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:51.970098 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3d4971dd-5210-43c2-959d-db852bebafdf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:51.970959 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3d4971dd-5210-43c2-959d-db852bebafdf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:51.971571 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3d4971dd-5210-43c2-959d-db852bebafdf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:51.972147 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3d4971dd-5210-43c2-959d-db852bebafdf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:52.112993 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3d4971dd-5210-43c2-959d-db852bebafdf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:52.130323 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-3d4971dd-5210-43c2-959d-db852bebafdf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1358 microversion: 2.1 time: 0.173443 Sep 20 22:30:52.130925 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 434/844] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:51 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:52.377971 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-df86250a-5cab-4636-bef3-3804997b88e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:52.378799 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-df86250a-5cab-4636-bef3-3804997b88e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:52.386410 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-df86250a-5cab-4636-bef3-3804997b88e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:52.386906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-df86250a-5cab-4636-bef3-3804997b88e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:52.387320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-df86250a-5cab-4636-bef3-3804997b88e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:52.388014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-df86250a-5cab-4636-bef3-3804997b88e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:52.388497 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-df86250a-5cab-4636-bef3-3804997b88e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:52.388917 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-df86250a-5cab-4636-bef3-3804997b88e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:52.420327 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-df86250a-5cab-4636-bef3-3804997b88e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:52.420813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-df86250a-5cab-4636-bef3-3804997b88e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:52.421854 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-df86250a-5cab-4636-bef3-3804997b88e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:52.422295 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-df86250a-5cab-4636-bef3-3804997b88e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lazy-loading 'fault' on Instance uuid a507bbd4-a0a2-4ca8-b04a-1511797060be {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:30:52.475675 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-df86250a-5cab-4636-bef3-3804997b88e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:52.486412 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-df86250a-5cab-4636-bef3-3804997b88e1 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1224 microversion: 2.1 time: 0.113040 Sep 20 22:30:52.490499 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 411/845] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:52 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1224 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:53.154533 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-1d27e57c-2fcb-45c2-b455-c72e953f660f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:53.155338 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-1d27e57c-2fcb-45c2-b455-c72e953f660f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:53.163565 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1d27e57c-2fcb-45c2-b455-c72e953f660f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:53.164434 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1d27e57c-2fcb-45c2-b455-c72e953f660f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:53.165139 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1d27e57c-2fcb-45c2-b455-c72e953f660f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:53.166139 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1d27e57c-2fcb-45c2-b455-c72e953f660f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:53.166833 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1d27e57c-2fcb-45c2-b455-c72e953f660f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:53.167474 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1d27e57c-2fcb-45c2-b455-c72e953f660f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:53.330633 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-1d27e57c-2fcb-45c2-b455-c72e953f660f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:53.341638 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-1d27e57c-2fcb-45c2-b455-c72e953f660f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1358 microversion: 2.1 time: 0.192110 Sep 20 22:30:53.343164 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 435/846] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:53 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:53.512619 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b3830ab9-d104-4b06-97b1-b40a887c5406 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:53.513171 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b3830ab9-d104-4b06-97b1-b40a887c5406 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:53.519679 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b3830ab9-d104-4b06-97b1-b40a887c5406 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:53.520471 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b3830ab9-d104-4b06-97b1-b40a887c5406 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:53.521384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b3830ab9-d104-4b06-97b1-b40a887c5406 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:53.537999 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b3830ab9-d104-4b06-97b1-b40a887c5406 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:53.538499 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b3830ab9-d104-4b06-97b1-b40a887c5406 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:53.538947 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b3830ab9-d104-4b06-97b1-b40a887c5406 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:53.617471 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b3830ab9-d104-4b06-97b1-b40a887c5406 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:53.618387 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b3830ab9-d104-4b06-97b1-b40a887c5406 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:53.619160 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b3830ab9-d104-4b06-97b1-b40a887c5406 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:53.619778 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-b3830ab9-d104-4b06-97b1-b40a887c5406 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lazy-loading 'fault' on Instance uuid a507bbd4-a0a2-4ca8-b04a-1511797060be {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:30:53.700056 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b3830ab9-d104-4b06-97b1-b40a887c5406 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:53.709607 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b3830ab9-d104-4b06-97b1-b40a887c5406 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1224 microversion: 2.1 time: 0.201092 Sep 20 22:30:53.717379 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 412/847] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:53 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1224 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:54.368451 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-8db7ec57-2a92-49ed-9d46-d642902b402c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:54.369244 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-8db7ec57-2a92-49ed-9d46-d642902b402c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:54.374377 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=4 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:54.381475 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8db7ec57-2a92-49ed-9d46-d642902b402c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:54.395611 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8db7ec57-2a92-49ed-9d46-d642902b402c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:54.396063 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8db7ec57-2a92-49ed-9d46-d642902b402c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:54.396821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8db7ec57-2a92-49ed-9d46-d642902b402c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:54.397316 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8db7ec57-2a92-49ed-9d46-d642902b402c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:54.397746 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8db7ec57-2a92-49ed-9d46-d642902b402c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:54.563242 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-8db7ec57-2a92-49ed-9d46-d642902b402c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:54.571033 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-8db7ec57-2a92-49ed-9d46-d642902b402c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1358 microversion: 2.1 time: 0.208763 Sep 20 22:30:54.571598 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 436/848] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:54 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:30:54.732551 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b5bd9d05-c8d6-4096-8486-cf61e38bd492 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:54.733803 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b5bd9d05-c8d6-4096-8486-cf61e38bd492 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:54.737489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:54.743837 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b5bd9d05-c8d6-4096-8486-cf61e38bd492 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:54.744298 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b5bd9d05-c8d6-4096-8486-cf61e38bd492 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:54.744726 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b5bd9d05-c8d6-4096-8486-cf61e38bd492 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:54.745449 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b5bd9d05-c8d6-4096-8486-cf61e38bd492 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:54.745896 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b5bd9d05-c8d6-4096-8486-cf61e38bd492 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:54.746310 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b5bd9d05-c8d6-4096-8486-cf61e38bd492 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:54.788240 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b5bd9d05-c8d6-4096-8486-cf61e38bd492 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:54.788846 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b5bd9d05-c8d6-4096-8486-cf61e38bd492 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:54.789400 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b5bd9d05-c8d6-4096-8486-cf61e38bd492 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:54.789915 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-b5bd9d05-c8d6-4096-8486-cf61e38bd492 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lazy-loading 'fault' on Instance uuid a507bbd4-a0a2-4ca8-b04a-1511797060be {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:30:54.833987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-b5bd9d05-c8d6-4096-8486-cf61e38bd492 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:54.842813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b5bd9d05-c8d6-4096-8486-cf61e38bd492 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1224 microversion: 2.1 time: 0.113917 Sep 20 22:30:54.844038 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 413/849] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:54 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:55.614953 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-8b0b7b45-ac95-471b-9eed-5b29a754794f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:55.616336 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-8b0b7b45-ac95-471b-9eed-5b29a754794f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:55.627717 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b0b7b45-ac95-471b-9eed-5b29a754794f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:55.628684 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b0b7b45-ac95-471b-9eed-5b29a754794f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:55.629389 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b0b7b45-ac95-471b-9eed-5b29a754794f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:55.630331 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b0b7b45-ac95-471b-9eed-5b29a754794f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:55.630994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b0b7b45-ac95-471b-9eed-5b29a754794f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:55.631625 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8b0b7b45-ac95-471b-9eed-5b29a754794f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:55.801275 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-8b0b7b45-ac95-471b-9eed-5b29a754794f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:55.812433 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-8b0b7b45-ac95-471b-9eed-5b29a754794f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1358 microversion: 2.1 time: 0.221960 Sep 20 22:30:55.814292 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 437/850] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:55 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:55.871669 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a03b9361-6c17-43e4-b07a-ee10b6d1f6e8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:55.873128 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a03b9361-6c17-43e4-b07a-ee10b6d1f6e8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:55.875803 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=2 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:55.881078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=8 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:55.891091 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a03b9361-6c17-43e4-b07a-ee10b6d1f6e8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:55.891813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a03b9361-6c17-43e4-b07a-ee10b6d1f6e8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:55.892557 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a03b9361-6c17-43e4-b07a-ee10b6d1f6e8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:55.893507 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a03b9361-6c17-43e4-b07a-ee10b6d1f6e8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:55.894173 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a03b9361-6c17-43e4-b07a-ee10b6d1f6e8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:55.894846 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a03b9361-6c17-43e4-b07a-ee10b6d1f6e8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:55.931495 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a03b9361-6c17-43e4-b07a-ee10b6d1f6e8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:55.932407 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a03b9361-6c17-43e4-b07a-ee10b6d1f6e8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:55.933001 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a03b9361-6c17-43e4-b07a-ee10b6d1f6e8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:55.933825 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-a03b9361-6c17-43e4-b07a-ee10b6d1f6e8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lazy-loading 'fault' on Instance uuid a507bbd4-a0a2-4ca8-b04a-1511797060be {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:30:56.011577 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a03b9361-6c17-43e4-b07a-ee10b6d1f6e8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:56.024965 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a03b9361-6c17-43e4-b07a-ee10b6d1f6e8 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1224 microversion: 2.1 time: 0.161499 Sep 20 22:30:56.025844 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 414/851] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:55 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1224 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:56.836662 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-dc57cf40-ef20-4289-965c-8ecaa168dd6a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:56.837323 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-dc57cf40-ef20-4289-965c-8ecaa168dd6a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:56.844165 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dc57cf40-ef20-4289-965c-8ecaa168dd6a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:56.844638 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dc57cf40-ef20-4289-965c-8ecaa168dd6a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:56.845095 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dc57cf40-ef20-4289-965c-8ecaa168dd6a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:56.845776 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dc57cf40-ef20-4289-965c-8ecaa168dd6a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:56.846222 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dc57cf40-ef20-4289-965c-8ecaa168dd6a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:56.846638 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dc57cf40-ef20-4289-965c-8ecaa168dd6a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:56.990498 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-dc57cf40-ef20-4289-965c-8ecaa168dd6a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:56.998660 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-dc57cf40-ef20-4289-965c-8ecaa168dd6a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1358 microversion: 2.1 time: 0.165815 Sep 20 22:30:56.999470 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 438/852] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:56 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:57.055760 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-7f402b9f-59d6-408f-b2e9-f322f0616a3d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:57.057874 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-7f402b9f-59d6-408f-b2e9-f322f0616a3d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:57.071252 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7f402b9f-59d6-408f-b2e9-f322f0616a3d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:57.072043 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7f402b9f-59d6-408f-b2e9-f322f0616a3d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:57.074789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7f402b9f-59d6-408f-b2e9-f322f0616a3d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:57.075962 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7f402b9f-59d6-408f-b2e9-f322f0616a3d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:57.076426 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7f402b9f-59d6-408f-b2e9-f322f0616a3d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:57.077018 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7f402b9f-59d6-408f-b2e9-f322f0616a3d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:57.122441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7f402b9f-59d6-408f-b2e9-f322f0616a3d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:57.122936 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7f402b9f-59d6-408f-b2e9-f322f0616a3d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:57.123371 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7f402b9f-59d6-408f-b2e9-f322f0616a3d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:57.123820 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-7f402b9f-59d6-408f-b2e9-f322f0616a3d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lazy-loading 'fault' on Instance uuid a507bbd4-a0a2-4ca8-b04a-1511797060be {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:30:57.170967 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-7f402b9f-59d6-408f-b2e9-f322f0616a3d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:57.179737 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-7f402b9f-59d6-408f-b2e9-f322f0616a3d tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1224 microversion: 2.1 time: 0.131179 Sep 20 22:30:57.180922 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 415/853] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:57 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1224 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:58.021404 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-23184e66-5f4b-4c78-be10-8c921f156af5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:58.022010 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-23184e66-5f4b-4c78-be10-8c921f156af5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:58.028590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-23184e66-5f4b-4c78-be10-8c921f156af5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:58.030822 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-23184e66-5f4b-4c78-be10-8c921f156af5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:58.031338 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-23184e66-5f4b-4c78-be10-8c921f156af5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:58.032121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-23184e66-5f4b-4c78-be10-8c921f156af5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:58.032746 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-23184e66-5f4b-4c78-be10-8c921f156af5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:58.033400 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-23184e66-5f4b-4c78-be10-8c921f156af5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:58.185452 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-23184e66-5f4b-4c78-be10-8c921f156af5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:58.193763 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-23184e66-5f4b-4c78-be10-8c921f156af5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1358 microversion: 2.1 time: 0.176191 Sep 20 22:30:58.194332 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 439/854] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:58 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:58.210257 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-acfd2ccc-3c2f-4d0c-984e-5d449e1cd79f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:58.210858 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-acfd2ccc-3c2f-4d0c-984e-5d449e1cd79f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:58.217426 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-acfd2ccc-3c2f-4d0c-984e-5d449e1cd79f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:58.218452 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-acfd2ccc-3c2f-4d0c-984e-5d449e1cd79f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:58.218885 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-acfd2ccc-3c2f-4d0c-984e-5d449e1cd79f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:58.219568 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-acfd2ccc-3c2f-4d0c-984e-5d449e1cd79f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:58.220017 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-acfd2ccc-3c2f-4d0c-984e-5d449e1cd79f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:58.220433 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-acfd2ccc-3c2f-4d0c-984e-5d449e1cd79f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:58.251973 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-acfd2ccc-3c2f-4d0c-984e-5d449e1cd79f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:58.252456 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-acfd2ccc-3c2f-4d0c-984e-5d449e1cd79f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:58.252885 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-acfd2ccc-3c2f-4d0c-984e-5d449e1cd79f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:58.253354 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-acfd2ccc-3c2f-4d0c-984e-5d449e1cd79f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lazy-loading 'fault' on Instance uuid a507bbd4-a0a2-4ca8-b04a-1511797060be {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:30:58.295514 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-acfd2ccc-3c2f-4d0c-984e-5d449e1cd79f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:58.304552 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-acfd2ccc-3c2f-4d0c-984e-5d449e1cd79f tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1224 microversion: 2.1 time: 0.098078 Sep 20 22:30:58.305159 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 416/855] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:58 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:59.215974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b3b7f06d-4976-4fe6-85ea-d8e282a1514b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:59.216584 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b3b7f06d-4976-4fe6-85ea-d8e282a1514b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:59.223390 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b3b7f06d-4976-4fe6-85ea-d8e282a1514b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:59.223865 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b3b7f06d-4976-4fe6-85ea-d8e282a1514b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:59.224294 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b3b7f06d-4976-4fe6-85ea-d8e282a1514b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:59.224988 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b3b7f06d-4976-4fe6-85ea-d8e282a1514b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:59.225438 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b3b7f06d-4976-4fe6-85ea-d8e282a1514b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:59.226119 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b3b7f06d-4976-4fe6-85ea-d8e282a1514b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:59.327687 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-32897e88-ed61-4750-8645-65c1f49993c6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:30:59.328535 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-32897e88-ed61-4750-8645-65c1f49993c6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:30:59.334919 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32897e88-ed61-4750-8645-65c1f49993c6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:59.335410 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32897e88-ed61-4750-8645-65c1f49993c6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:59.335849 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32897e88-ed61-4750-8645-65c1f49993c6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:59.336545 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32897e88-ed61-4750-8645-65c1f49993c6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:59.337022 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32897e88-ed61-4750-8645-65c1f49993c6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:59.337453 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32897e88-ed61-4750-8645-65c1f49993c6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:59.351164 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b3b7f06d-4976-4fe6-85ea-d8e282a1514b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:59.358608 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b3b7f06d-4976-4fe6-85ea-d8e282a1514b tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1358 microversion: 2.1 time: 0.146480 Sep 20 22:30:59.359175 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 440/856] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:59 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:30:59.368527 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32897e88-ed61-4750-8645-65c1f49993c6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:30:59.369040 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32897e88-ed61-4750-8645-65c1f49993c6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:30:59.369557 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-32897e88-ed61-4750-8645-65c1f49993c6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:30:59.370001 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-32897e88-ed61-4750-8645-65c1f49993c6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lazy-loading 'fault' on Instance uuid a507bbd4-a0a2-4ca8-b04a-1511797060be {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:30:59.409729 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-32897e88-ed61-4750-8645-65c1f49993c6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:30:59.417206 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-32897e88-ed61-4750-8645-65c1f49993c6 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1224 microversion: 2.1 time: 0.093914 Sep 20 22:30:59.417775 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 417/857] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:30:59 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:31:00.381317 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-61d3c5d7-5fa9-4ea0-ae8a-3641cd1c3dbe tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:00.381932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-61d3c5d7-5fa9-4ea0-ae8a-3641cd1c3dbe tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:00.388347 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61d3c5d7-5fa9-4ea0-ae8a-3641cd1c3dbe tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:00.388833 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61d3c5d7-5fa9-4ea0-ae8a-3641cd1c3dbe tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:00.389312 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61d3c5d7-5fa9-4ea0-ae8a-3641cd1c3dbe tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:00.390005 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61d3c5d7-5fa9-4ea0-ae8a-3641cd1c3dbe tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:00.390462 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61d3c5d7-5fa9-4ea0-ae8a-3641cd1c3dbe tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:00.390888 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61d3c5d7-5fa9-4ea0-ae8a-3641cd1c3dbe tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:00.409093 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:00.440361 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-14178c9d-4dc4-47e5-906d-11c0aefbafab tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:00.440989 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-14178c9d-4dc4-47e5-906d-11c0aefbafab tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:00.446829 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-14178c9d-4dc4-47e5-906d-11c0aefbafab tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:00.447310 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-14178c9d-4dc4-47e5-906d-11c0aefbafab tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:00.447746 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-14178c9d-4dc4-47e5-906d-11c0aefbafab tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:00.448435 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-14178c9d-4dc4-47e5-906d-11c0aefbafab tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:00.448891 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-14178c9d-4dc4-47e5-906d-11c0aefbafab tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:00.449343 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-14178c9d-4dc4-47e5-906d-11c0aefbafab tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:00.479933 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-14178c9d-4dc4-47e5-906d-11c0aefbafab tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:00.480413 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-14178c9d-4dc4-47e5-906d-11c0aefbafab tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:00.480841 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-14178c9d-4dc4-47e5-906d-11c0aefbafab tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:00.481507 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-14178c9d-4dc4-47e5-906d-11c0aefbafab tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lazy-loading 'fault' on Instance uuid a507bbd4-a0a2-4ca8-b04a-1511797060be {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:31:00.484817 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=100 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:00.524240 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-61d3c5d7-5fa9-4ea0-ae8a-3641cd1c3dbe tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:00.525271 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-14178c9d-4dc4-47e5-906d-11c0aefbafab tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:00.532477 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-61d3c5d7-5fa9-4ea0-ae8a-3641cd1c3dbe tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1358 microversion: 2.1 time: 0.155063 Sep 20 22:31:00.533074 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 441/858] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:00 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:00.533241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-14178c9d-4dc4-47e5-906d-11c0aefbafab tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1224 microversion: 2.1 time: 0.097417 Sep 20 22:31:00.533747 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 418/859] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:00 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:31:01.554903 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-38370229-2934-46b0-9eea-67222b093a80 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:01.555495 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-f809ce1c-7391-4593-b622-ad9c710f258d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:01.555869 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-38370229-2934-46b0-9eea-67222b093a80 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:01.555992 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-f809ce1c-7391-4593-b622-ad9c710f258d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:01.561954 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f809ce1c-7391-4593-b622-ad9c710f258d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:01.562125 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-38370229-2934-46b0-9eea-67222b093a80 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:01.562447 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f809ce1c-7391-4593-b622-ad9c710f258d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:01.562576 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-38370229-2934-46b0-9eea-67222b093a80 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:01.562883 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-38370229-2934-46b0-9eea-67222b093a80 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:01.562999 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f809ce1c-7391-4593-b622-ad9c710f258d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:01.563566 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-38370229-2934-46b0-9eea-67222b093a80 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:01.563678 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f809ce1c-7391-4593-b622-ad9c710f258d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:01.564013 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-38370229-2934-46b0-9eea-67222b093a80 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:01.564140 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f809ce1c-7391-4593-b622-ad9c710f258d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:01.564429 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-38370229-2934-46b0-9eea-67222b093a80 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:01.564559 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f809ce1c-7391-4593-b622-ad9c710f258d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:01.596147 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-38370229-2934-46b0-9eea-67222b093a80 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:01.596625 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-38370229-2934-46b0-9eea-67222b093a80 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:01.597081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-38370229-2934-46b0-9eea-67222b093a80 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:01.597518 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-38370229-2934-46b0-9eea-67222b093a80 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lazy-loading 'fault' on Instance uuid a507bbd4-a0a2-4ca8-b04a-1511797060be {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:31:01.636943 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-38370229-2934-46b0-9eea-67222b093a80 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0ce4393b244819aa940ab5cd6b5812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c755c2cb864d05ac8561716aba8ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:01.645230 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-38370229-2934-46b0-9eea-67222b093a80 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 200 len: 1224 microversion: 2.1 time: 0.094224 Sep 20 22:31:01.645793 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 442/860] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:01 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:31:01.695607 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f809ce1c-7391-4593-b622-ad9c710f258d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:01.703718 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-f809ce1c-7391-4593-b622-ad9c710f258d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1358 microversion: 2.1 time: 0.152535 Sep 20 22:31:01.704276 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 419/861] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:01 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:31:02.670764 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-174a0f63-8fe1-407f-8490-c14cc6877d44 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:02.671885 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-174a0f63-8fe1-407f-8490-c14cc6877d44 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] [instance: a507bbd4-a0a2-4ca8-b04a-1511797060be] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:02.677761 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-174a0f63-8fe1-407f-8490-c14cc6877d44 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:02.678239 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-174a0f63-8fe1-407f-8490-c14cc6877d44 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:02.678669 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-174a0f63-8fe1-407f-8490-c14cc6877d44 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:02.679344 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-174a0f63-8fe1-407f-8490-c14cc6877d44 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:02.679792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-174a0f63-8fe1-407f-8490-c14cc6877d44 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:02.680205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-174a0f63-8fe1-407f-8490-c14cc6877d44 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:02.693548 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-174a0f63-8fe1-407f-8490-c14cc6877d44 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] HTTP exception thrown: Instance a507bbd4-a0a2-4ca8-b04a-1511797060be could not be found. Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-174a0f63-8fe1-407f-8490-c14cc6877d44 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Request method failure captured: Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be HTTP/1.1 Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj3Upfg7KB0YaVgSP_7HTDvvz7_-Tl-4Hbi7CQISJFvjhmHNQtySdyxVvT0ZkTlAc31sI7bj4kUtoYtsnkybp9W87n0fq5oiIclS1vmW-FQmThw8j1doPqBLvF7YTgbDqYdemoBOtvV_EFLL1HvWOWPgCvjDNiLF4Cw6LRs-KXXjniw Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 99c755c2cb864d05ac8561716aba8ae2 Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-TestShelveInstance-15524529 Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:31:02.695143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:31:02.696687 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99c755c2cb864d05ac8561716aba8ae2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_99c755c2cb864d05ac8561716aba8ae2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/99c755c2cb864d05ac8561716aba8ae2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99c755c2cb864d05ac8561716aba8ae2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:31:02.696687 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-TestShelveInstance-15524529 Sep 20 22:31:02.696687 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 99c755c2cb864d05ac8561716aba8ae2 Sep 20 22:31:02.696687 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-TestShelveInstance-15524529 Sep 20 22:31:02.696687 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-TestShelveInstance-15524529-project Sep 20 22:31:02.696687 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:31:02.696687 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:31:02.696687 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 1c0ce4393b244819aa940ab5cd6b5812 Sep 20 22:31:02.696687 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-TestShelveInstance-15524529-project Sep 20 22:31:02.696687 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:31:02.696687 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance a507bbd4-a0a2-4ca8-b04a-1511797060be could not be found. Sep 20 22:31:02.696687 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': 'a507bbd4-a0a2-4ca8-b04a-1511797060be'} Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a507bbd4-a0a2-4ca8-b04a-1511797060be could not be found. Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:31:02.697624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:31:02.699121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:31:02.699121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:31:02.699121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:31:02.699121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:31:02.699121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:31:02.699121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:31:02.699121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:31:02.699121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a507bbd4-a0a2-4ca8-b04a-1511797060be could not be found. Sep 20 22:31:02.699121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:31:02.699121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:31:02.699121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:31:02.699121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:31:02.699121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:31:02.699121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:31:02.699121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:31:02.699121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:31:02.699121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a507bbd4-a0a2-4ca8-b04a-1511797060be could not be found. Sep 20 22:31:02.699121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:31:02.700695 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-174a0f63-8fe1-407f-8490-c14cc6877d44 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Returning 404 to user: Instance a507bbd4-a0a2-4ca8-b04a-1511797060be could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:31:02.700695 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-174a0f63-8fe1-407f-8490-c14cc6877d44 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be" status: 404 len: 111 microversion: 2.1 time: 0.030494 Sep 20 22:31:02.700695 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 443/862] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:02 2022] GET /compute/v2.1/servers/a507bbd4-a0a2-4ca8-b04a-1511797060be => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:31:02.726328 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c3264785-5ddf-4cc1-9918-535d2a82a926 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:02.726937 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c3264785-5ddf-4cc1-9918-535d2a82a926 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:02.734931 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c3264785-5ddf-4cc1-9918-535d2a82a926 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:02.735425 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c3264785-5ddf-4cc1-9918-535d2a82a926 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:02.735859 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c3264785-5ddf-4cc1-9918-535d2a82a926 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:02.736591 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c3264785-5ddf-4cc1-9918-535d2a82a926 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:02.737253 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c3264785-5ddf-4cc1-9918-535d2a82a926 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:02.737675 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c3264785-5ddf-4cc1-9918-535d2a82a926 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:02.869612 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c3264785-5ddf-4cc1-9918-535d2a82a926 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:02.877969 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-c3264785-5ddf-4cc1-9918-535d2a82a926 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1358 microversion: 2.1 time: 0.155474 Sep 20 22:31:02.878638 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 420/863] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:02 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:03.256201 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ad6e23e7-4ce4-452e-a3f1-27dea8959438 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] Calling method '.version_select at 0x7f24f6680dc0>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:03.279629 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ad6e23e7-4ce4-452e-a3f1-27dea8959438 tempest-TestShelveInstance-15524529 tempest-TestShelveInstance-15524529-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-171289814" status: 202 len: 0 microversion: 2.1 time: 0.026376 Sep 20 22:31:03.285055 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 444/864] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 20 22:31:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-171289814 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:31:03.911439 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-fa218319-9d67-4ca5-9c8b-06f0d4438e39 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:03.912704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-fa218319-9d67-4ca5-9c8b-06f0d4438e39 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:03.936328 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fa218319-9d67-4ca5-9c8b-06f0d4438e39 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:03.939288 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fa218319-9d67-4ca5-9c8b-06f0d4438e39 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:03.939789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fa218319-9d67-4ca5-9c8b-06f0d4438e39 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:03.940552 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fa218319-9d67-4ca5-9c8b-06f0d4438e39 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:03.941479 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fa218319-9d67-4ca5-9c8b-06f0d4438e39 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:03.941921 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-fa218319-9d67-4ca5-9c8b-06f0d4438e39 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:04.154339 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-fa218319-9d67-4ca5-9c8b-06f0d4438e39 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:04.162061 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-fa218319-9d67-4ca5-9c8b-06f0d4438e39 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1358 microversion: 2.1 time: 0.263066 Sep 20 22:31:04.162725 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 421/865] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:03 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:05.187803 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-1b39e01a-371f-4464-87bd-12ad22937cdc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:05.189871 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-1b39e01a-371f-4464-87bd-12ad22937cdc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:05.205211 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1b39e01a-371f-4464-87bd-12ad22937cdc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:05.205705 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1b39e01a-371f-4464-87bd-12ad22937cdc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:05.206144 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1b39e01a-371f-4464-87bd-12ad22937cdc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:05.206858 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1b39e01a-371f-4464-87bd-12ad22937cdc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:05.207315 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1b39e01a-371f-4464-87bd-12ad22937cdc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:05.207737 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1b39e01a-371f-4464-87bd-12ad22937cdc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:05.349223 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-1b39e01a-371f-4464-87bd-12ad22937cdc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:05.358168 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-1b39e01a-371f-4464-87bd-12ad22937cdc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1358 microversion: 2.1 time: 0.175983 Sep 20 22:31:05.359517 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 445/866] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:05 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:06.382468 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-e47c6ee4-cbc8-4def-8afc-41fb502acd62 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:06.383728 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-e47c6ee4-cbc8-4def-8afc-41fb502acd62 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:06.391069 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e47c6ee4-cbc8-4def-8afc-41fb502acd62 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:06.391831 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e47c6ee4-cbc8-4def-8afc-41fb502acd62 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:06.392516 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e47c6ee4-cbc8-4def-8afc-41fb502acd62 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:06.393468 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e47c6ee4-cbc8-4def-8afc-41fb502acd62 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:06.394855 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e47c6ee4-cbc8-4def-8afc-41fb502acd62 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:06.395496 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e47c6ee4-cbc8-4def-8afc-41fb502acd62 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:06.693831 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-e47c6ee4-cbc8-4def-8afc-41fb502acd62 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:06.702669 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-e47c6ee4-cbc8-4def-8afc-41fb502acd62 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1358 microversion: 2.1 time: 0.323240 Sep 20 22:31:06.703639 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 422/867] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:06 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1358 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:06.995800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-3956a293-4538-4d75-af46-a72bf443ca6e req-96789892-fdb9-4c23-a746-4a773cb1079f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c51ac84a-e21e-470f-b1c4-c542a1b8f553", "name": "network-vif-plugged", "status": "completed", "tag": "2c27dc78-c19b-4ad9-b5ae-35688f10f1a8"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:31:07.008490 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-3956a293-4538-4d75-af46-a72bf443ca6e req-96789892-fdb9-4c23-a746-4a773cb1079f service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:07.008895 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-3956a293-4538-4d75-af46-a72bf443ca6e req-96789892-fdb9-4c23-a746-4a773cb1079f service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:07.009552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-3956a293-4538-4d75-af46-a72bf443ca6e req-96789892-fdb9-4c23-a746-4a773cb1079f service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:07.023081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-3956a293-4538-4d75-af46-a72bf443ca6e req-96789892-fdb9-4c23-a746-4a773cb1079f service nova] Creating event network-vif-plugged:2c27dc78-c19b-4ad9-b5ae-35688f10f1a8 for instance c51ac84a-e21e-470f-b1c4-c542a1b8f553 on hv-cinder-85827 Sep 20 22:31:07.029706 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-3956a293-4538-4d75-af46-a72bf443ca6e req-96789892-fdb9-4c23-a746-4a773cb1079f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037718 Sep 20 22:31:07.030925 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 446/868] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:31:07.725686 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-7ba4fce0-5ed6-442f-a257-283d3480fd45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:07.726296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-7ba4fce0-5ed6-442f-a257-283d3480fd45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:07.732382 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7ba4fce0-5ed6-442f-a257-283d3480fd45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:07.733106 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7ba4fce0-5ed6-442f-a257-283d3480fd45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:07.734209 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7ba4fce0-5ed6-442f-a257-283d3480fd45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:07.735222 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7ba4fce0-5ed6-442f-a257-283d3480fd45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:07.735670 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7ba4fce0-5ed6-442f-a257-283d3480fd45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:07.736269 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7ba4fce0-5ed6-442f-a257-283d3480fd45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:07.977308 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-7ba4fce0-5ed6-442f-a257-283d3480fd45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:07.986701 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-7ba4fce0-5ed6-442f-a257-283d3480fd45 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1358 microversion: 2.1 time: 0.264971 Sep 20 22:31:07.988013 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 423/869] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:07 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:09.012004 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3922058f-e3d6-4d24-a322-83c793c59eb2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:09.012004 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-3922058f-e3d6-4d24-a322-83c793c59eb2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:09.019865 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3922058f-e3d6-4d24-a322-83c793c59eb2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:09.020798 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3922058f-e3d6-4d24-a322-83c793c59eb2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:09.021279 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3922058f-e3d6-4d24-a322-83c793c59eb2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:09.022041 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3922058f-e3d6-4d24-a322-83c793c59eb2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:09.022498 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3922058f-e3d6-4d24-a322-83c793c59eb2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:09.022938 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3922058f-e3d6-4d24-a322-83c793c59eb2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:09.191133 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3922058f-e3d6-4d24-a322-83c793c59eb2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:09.203255 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-3922058f-e3d6-4d24-a322-83c793c59eb2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1547 microversion: 2.1 time: 0.195877 Sep 20 22:31:09.204740 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 447/870] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:09 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1547 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:09.226825 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-cb6c781a-b5ca-4dd6-86ba-d8ba8e96248c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:09.227439 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-cb6c781a-b5ca-4dd6-86ba-d8ba8e96248c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:09.235280 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cb6c781a-b5ca-4dd6-86ba-d8ba8e96248c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:09.235771 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cb6c781a-b5ca-4dd6-86ba-d8ba8e96248c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:09.237535 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cb6c781a-b5ca-4dd6-86ba-d8ba8e96248c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:09.238243 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cb6c781a-b5ca-4dd6-86ba-d8ba8e96248c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:09.238723 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cb6c781a-b5ca-4dd6-86ba-d8ba8e96248c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:09.239120 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cb6c781a-b5ca-4dd6-86ba-d8ba8e96248c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:09.464382 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-cb6c781a-b5ca-4dd6-86ba-d8ba8e96248c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:09.474113 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-cb6c781a-b5ca-4dd6-86ba-d8ba8e96248c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1547 microversion: 2.1 time: 0.251034 Sep 20 22:31:09.474837 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 424/871] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:09 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1547 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:09.497240 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-303bcb1f-4723-4aad-a644-e9a9928f0b07 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:09.503148 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-303bcb1f-4723-4aad-a644-e9a9928f0b07 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:09.504038 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-303bcb1f-4723-4aad-a644-e9a9928f0b07 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Searching by: {'deleted': False, 'project_id': '021bf48fb20347f8bb6664c066b2c93f'} {{(pid=120474) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 20 22:31:09.511151 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-303bcb1f-4723-4aad-a644-e9a9928f0b07 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:09.511760 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-303bcb1f-4723-4aad-a644-e9a9928f0b07 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:09.512293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-303bcb1f-4723-4aad-a644-e9a9928f0b07 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:09.513172 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-303bcb1f-4723-4aad-a644-e9a9928f0b07 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:09.513723 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-303bcb1f-4723-4aad-a644-e9a9928f0b07 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:09.514263 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-303bcb1f-4723-4aad-a644-e9a9928f0b07 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:09.788659 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.multi_cell_list [None req-303bcb1f-4723-4aad-a644-e9a9928f0b07 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 20 22:31:09.912005 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-303bcb1f-4723-4aad-a644-e9a9928f0b07 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.418908 Sep 20 22:31:09.912525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 448/872] 10.222.0.16 () {58 vars in 1125 bytes} [Tue Sep 20 22:31:09 2022] GET /compute/v2.1/servers => generated 343 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:31:09.925522 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-4342bc8d-d6c9-41f9-b1c6-b5cdecd7e579 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:09.926160 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-4342bc8d-d6c9-41f9-b1c6-b5cdecd7e579 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:09.933339 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4342bc8d-d6c9-41f9-b1c6-b5cdecd7e579 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:09.933909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4342bc8d-d6c9-41f9-b1c6-b5cdecd7e579 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:09.934350 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4342bc8d-d6c9-41f9-b1c6-b5cdecd7e579 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:09.935098 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4342bc8d-d6c9-41f9-b1c6-b5cdecd7e579 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:09.935563 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4342bc8d-d6c9-41f9-b1c6-b5cdecd7e579 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:09.935993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4342bc8d-d6c9-41f9-b1c6-b5cdecd7e579 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:10.300242 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-4342bc8d-d6c9-41f9-b1c6-b5cdecd7e579 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:10.308745 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-4342bc8d-d6c9-41f9-b1c6-b5cdecd7e579 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1547 microversion: 2.1 time: 0.387932 Sep 20 22:31:10.309356 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 425/873] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:09 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1547 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:10.854865 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-0c8b7f8d-b167-45c0-bdba-64d5fa639b2e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:10.880281 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-0c8b7f8d-b167-45c0-bdba-64d5fa639b2e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:10.894132 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0c8b7f8d-b167-45c0-bdba-64d5fa639b2e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:10.894805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0c8b7f8d-b167-45c0-bdba-64d5fa639b2e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:10.895259 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0c8b7f8d-b167-45c0-bdba-64d5fa639b2e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:10.895944 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0c8b7f8d-b167-45c0-bdba-64d5fa639b2e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:10.896553 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0c8b7f8d-b167-45c0-bdba-64d5fa639b2e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:10.897222 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0c8b7f8d-b167-45c0-bdba-64d5fa639b2e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:10.932574 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-0c8b7f8d-b167-45c0-bdba-64d5fa639b2e tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.084298 Sep 20 22:31:10.933878 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 449/874] 10.222.0.16 () {60 vars in 1343 bytes} [Tue Sep 20 22:31:10 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:31:11.002061 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6c6cc68d-c140-42e3-bba5-ad09606e4423 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:11.002557 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-6c6cc68d-c140-42e3-bba5-ad09606e4423 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:11.009375 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6c6cc68d-c140-42e3-bba5-ad09606e4423 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:11.010118 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6c6cc68d-c140-42e3-bba5-ad09606e4423 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:11.010552 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6c6cc68d-c140-42e3-bba5-ad09606e4423 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:11.011416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6c6cc68d-c140-42e3-bba5-ad09606e4423 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:11.012068 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6c6cc68d-c140-42e3-bba5-ad09606e4423 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:11.012685 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6c6cc68d-c140-42e3-bba5-ad09606e4423 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:11.041001 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-6c6cc68d-c140-42e3-bba5-ad09606e4423 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Going to try to terminate instance {{(pid=120473) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:31:11.145449 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-6c6cc68d-c140-42e3-bba5-ad09606e4423 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "DELETE /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 204 len: 0 microversion: 2.20 time: 0.147261 Sep 20 22:31:11.147056 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 426/875] 10.222.0.16 () {60 vars in 1280 bytes} [Tue Sep 20 22:31:10 2022] DELETE /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 20 22:31:11.156488 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b4ba6be3-9f69-4954-adad-ac9a4459571d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:11.157224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b4ba6be3-9f69-4954-adad-ac9a4459571d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:11.163913 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b4ba6be3-9f69-4954-adad-ac9a4459571d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:11.164421 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b4ba6be3-9f69-4954-adad-ac9a4459571d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:11.164930 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b4ba6be3-9f69-4954-adad-ac9a4459571d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:11.165758 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b4ba6be3-9f69-4954-adad-ac9a4459571d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:11.169878 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b4ba6be3-9f69-4954-adad-ac9a4459571d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:11.170465 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b4ba6be3-9f69-4954-adad-ac9a4459571d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:11.354669 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b4ba6be3-9f69-4954-adad-ac9a4459571d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:11.362996 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b4ba6be3-9f69-4954-adad-ac9a4459571d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:11.364730 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b4ba6be3-9f69-4954-adad-ac9a4459571d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:11.365922 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b4ba6be3-9f69-4954-adad-ac9a4459571d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.214472 Sep 20 22:31:11.366489 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 450/876] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:31:11 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:31:12.003058 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-050abe57-77ee-48bc-8fa6-4632242a0d97 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e21aa185-e564-4277-9c64-95522244e756"}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:31:12.005471 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-050abe57-77ee-48bc-8fa6-4632242a0d97 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:12.012188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-050abe57-77ee-48bc-8fa6-4632242a0d97 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:12.012677 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-050abe57-77ee-48bc-8fa6-4632242a0d97 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:12.013143 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-050abe57-77ee-48bc-8fa6-4632242a0d97 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:12.013846 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-050abe57-77ee-48bc-8fa6-4632242a0d97 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:12.014307 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-050abe57-77ee-48bc-8fa6-4632242a0d97 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:12.014815 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-050abe57-77ee-48bc-8fa6-4632242a0d97 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:12.393903 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-41317fd5-ba6d-4b22-a410-1a15435a8e4f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:12.395277 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-41317fd5-ba6d-4b22-a410-1a15435a8e4f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:12.407621 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-41317fd5-ba6d-4b22-a410-1a15435a8e4f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:12.411323 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-41317fd5-ba6d-4b22-a410-1a15435a8e4f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:12.411992 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-41317fd5-ba6d-4b22-a410-1a15435a8e4f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:12.412821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-41317fd5-ba6d-4b22-a410-1a15435a8e4f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:12.417246 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-41317fd5-ba6d-4b22-a410-1a15435a8e4f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:12.417762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-41317fd5-ba6d-4b22-a410-1a15435a8e4f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:12.491899 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-050abe57-77ee-48bc-8fa6-4632242a0d97 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "POST /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.493180 Sep 20 22:31:12.492854 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 427/877] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 20 22:31:11 2022] POST /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553/os-volume_attachments => generated 194 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:31:12.631000 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-41317fd5-ba6d-4b22-a410-1a15435a8e4f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:12.639455 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-41317fd5-ba6d-4b22-a410-1a15435a8e4f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:12.640991 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-41317fd5-ba6d-4b22-a410-1a15435a8e4f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:12.642164 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-41317fd5-ba6d-4b22-a410-1a15435a8e4f tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1723 microversion: 2.20 time: 0.253222 Sep 20 22:31:12.642707 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 451/878] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:31:12 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:31:13.435850 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-92f15bea-ca62-44de-b89c-ee64068d4e92 req-a928118f-c1a6-4083-bf82-a3ffc323dc1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822d0d2c-d682-4143-b1b3-7feeaf3636f7", "name": "network-vif-deleted", "tag": "d76e99ad-dedc-45dd-ba58-8632f5cb0aba"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:31:13.446062 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-92f15bea-ca62-44de-b89c-ee64068d4e92 req-a928118f-c1a6-4083-bf82-a3ffc323dc1c service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:13.446540 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-92f15bea-ca62-44de-b89c-ee64068d4e92 req-a928118f-c1a6-4083-bf82-a3ffc323dc1c service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:13.446964 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-92f15bea-ca62-44de-b89c-ee64068d4e92 req-a928118f-c1a6-4083-bf82-a3ffc323dc1c service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:13.458672 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-92f15bea-ca62-44de-b89c-ee64068d4e92 req-a928118f-c1a6-4083-bf82-a3ffc323dc1c service nova] Creating event network-vif-deleted:d76e99ad-dedc-45dd-ba58-8632f5cb0aba for instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 on hv-cinder-85827 Sep 20 22:31:13.463594 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-92f15bea-ca62-44de-b89c-ee64068d4e92 req-a928118f-c1a6-4083-bf82-a3ffc323dc1c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032687 Sep 20 22:31:13.464229 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 428/879] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:31:13.671796 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-58bc4c10-24e2-43be-b167-1703a0eb42f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:13.672524 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-58bc4c10-24e2-43be-b167-1703a0eb42f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:13.675833 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:13.684598 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58bc4c10-24e2-43be-b167-1703a0eb42f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:13.685344 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58bc4c10-24e2-43be-b167-1703a0eb42f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:13.685970 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58bc4c10-24e2-43be-b167-1703a0eb42f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:13.687180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58bc4c10-24e2-43be-b167-1703a0eb42f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:13.687822 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58bc4c10-24e2-43be-b167-1703a0eb42f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:13.688567 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58bc4c10-24e2-43be-b167-1703a0eb42f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:13.731021 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58bc4c10-24e2-43be-b167-1703a0eb42f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:13.731753 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58bc4c10-24e2-43be-b167-1703a0eb42f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:13.732569 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-58bc4c10-24e2-43be-b167-1703a0eb42f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:13.733765 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-58bc4c10-24e2-43be-b167-1703a0eb42f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lazy-loading 'fault' on Instance uuid 822d0d2c-d682-4143-b1b3-7feeaf3636f7 {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:31:13.783316 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-58bc4c10-24e2-43be-b167-1703a0eb42f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:13.791953 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-58bc4c10-24e2-43be-b167-1703a0eb42f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:13.793407 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-58bc4c10-24e2-43be-b167-1703a0eb42f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69928e19721a455fb614c6f755495449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897090e72bcc4d978384c95688ab8021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:13.794782 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-58bc4c10-24e2-43be-b167-1703a0eb42f8 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 200 len: 1371 microversion: 2.20 time: 0.127710 Sep 20 22:31:13.797178 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 452/880] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:31:13 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 1371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 20 22:31:14.822348 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b2f40dac-2ed2-4f0c-bc86-34b0fa34d01c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:14.823042 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b2f40dac-2ed2-4f0c-bc86-34b0fa34d01c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:14.829716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b2f40dac-2ed2-4f0c-bc86-34b0fa34d01c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:14.830200 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b2f40dac-2ed2-4f0c-bc86-34b0fa34d01c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:14.830629 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b2f40dac-2ed2-4f0c-bc86-34b0fa34d01c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:14.831313 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b2f40dac-2ed2-4f0c-bc86-34b0fa34d01c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:14.831757 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b2f40dac-2ed2-4f0c-bc86-34b0fa34d01c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:14.832174 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b2f40dac-2ed2-4f0c-bc86-34b0fa34d01c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:14.845212 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-b2f40dac-2ed2-4f0c-bc86-34b0fa34d01c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] HTTP exception thrown: Instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 could not be found. Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b2f40dac-2ed2-4f0c-bc86-34b0fa34d01c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Request method failure captured: Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 HTTP/1.1 Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj18syVDTaZWh7W51ZRKRb7NAdLaqAWn0_TI66AArVf0KyOeVdN9jJ1xQXel-um3xDw7PejpUUXU7wWaNaPTdS5rx_zamPaTjpnWIXNPBQRsMOtA7rMx0UUKlJVF91ITK-vT2WtQeF5k0Uolnnw406Dn4eI5JGv2TjN96CC1qhf2X_Y Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Openstack-Nova-Api-Version: 2.20 Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: 897090e72bcc4d978384c95688ab8021 Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-790319658 Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:31:14.846888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:31:14.848560 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/897090e72bcc4d978384c95688ab8021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_897090e72bcc4d978384c95688ab8021", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/897090e72bcc4d978384c95688ab8021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/897090e72bcc4d978384c95688ab8021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:31:14.848560 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-AttachVolumeShelveTestJSON-790319658 Sep 20 22:31:14.848560 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: 897090e72bcc4d978384c95688ab8021 Sep 20 22:31:14.848560 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-790319658 Sep 20 22:31:14.848560 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-AttachVolumeShelveTestJSON-790319658-project Sep 20 22:31:14.848560 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:31:14.848560 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:31:14.848560 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 69928e19721a455fb614c6f755495449 Sep 20 22:31:14.848560 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-AttachVolumeShelveTestJSON-790319658-project Sep 20 22:31:14.848560 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:31:14.848560 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 could not be found. Sep 20 22:31:14.848560 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': '822d0d2c-d682-4143-b1b3-7feeaf3636f7'} Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 could not be found. Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:31:14.849458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:31:14.850909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:31:14.850909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:31:14.850909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:31:14.850909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:31:14.850909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:31:14.850909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:31:14.850909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:31:14.850909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 could not be found. Sep 20 22:31:14.850909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:31:14.850909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:31:14.850909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:31:14.850909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:31:14.850909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:31:14.850909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:31:14.850909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:31:14.850909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:31:14.850909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 could not be found. Sep 20 22:31:14.850909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:31:14.852615 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b2f40dac-2ed2-4f0c-bc86-34b0fa34d01c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Returning 404 to user: Instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:31:14.852615 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b2f40dac-2ed2-4f0c-bc86-34b0fa34d01c tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 404 len: 111 microversion: 2.20 time: 0.031017 Sep 20 22:31:14.852615 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 429/881] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:31:14 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 20 22:31:14.857239 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a5807bc8-6712-4ac4-970a-141f90e690eb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '.version_select at 0x7f24f6839280>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:14.882425 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a5807bc8-6712-4ac4-970a-141f90e690eb tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-132269335" status: 204 len: 0 microversion: 2.20 time: 0.029013 Sep 20 22:31:14.883093 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 453/882] 10.222.0.16 () {60 vars in 1259 bytes} [Tue Sep 20 22:31:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-132269335 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 20 22:31:16.635571 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-08b106b1-d7d9-4cf8-bbf2-067f70c2e13d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:16.636092 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-08b106b1-d7d9-4cf8-bbf2-067f70c2e13d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:16.642895 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-08b106b1-d7d9-4cf8-bbf2-067f70c2e13d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:16.643369 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-08b106b1-d7d9-4cf8-bbf2-067f70c2e13d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:16.643797 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-08b106b1-d7d9-4cf8-bbf2-067f70c2e13d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:16.644475 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-08b106b1-d7d9-4cf8-bbf2-067f70c2e13d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:16.644921 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-08b106b1-d7d9-4cf8-bbf2-067f70c2e13d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:16.645367 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-08b106b1-d7d9-4cf8-bbf2-067f70c2e13d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:16.660353 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-08b106b1-d7d9-4cf8-bbf2-067f70c2e13d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] HTTP exception thrown: Instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 could not be found. Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-08b106b1-d7d9-4cf8-bbf2-067f70c2e13d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Request method failure captured: Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: DELETE /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 HTTP/1.1 Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj18syVDTaZWh7W51ZRKRb7NAdLaqAWn0_TI66AArVf0KyOeVdN9jJ1xQXel-um3xDw7PejpUUXU7wWaNaPTdS5rx_zamPaTjpnWIXNPBQRsMOtA7rMx0UUKlJVF91ITK-vT2WtQeF5k0Uolnnw406Dn4eI5JGv2TjN96CC1qhf2X_Y Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Openstack-Nova-Api-Version: 2.20 Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: 897090e72bcc4d978384c95688ab8021 Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-790319658 Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:31:16.661916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:31:16.663593 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/897090e72bcc4d978384c95688ab8021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_897090e72bcc4d978384c95688ab8021", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/897090e72bcc4d978384c95688ab8021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/897090e72bcc4d978384c95688ab8021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:31:16.663593 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-AttachVolumeShelveTestJSON-790319658 Sep 20 22:31:16.663593 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: 897090e72bcc4d978384c95688ab8021 Sep 20 22:31:16.663593 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-790319658 Sep 20 22:31:16.663593 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-AttachVolumeShelveTestJSON-790319658-project Sep 20 22:31:16.663593 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:31:16.663593 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:31:16.663593 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 69928e19721a455fb614c6f755495449 Sep 20 22:31:16.663593 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-AttachVolumeShelveTestJSON-790319658-project Sep 20 22:31:16.663593 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:31:16.663593 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 could not be found. Sep 20 22:31:16.663593 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': '822d0d2c-d682-4143-b1b3-7feeaf3636f7'} Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 could not be found. Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:31:16.664712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 could not be found. Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 could not be found. Sep 20 22:31:16.666220 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:31:16.667782 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-08b106b1-d7d9-4cf8-bbf2-067f70c2e13d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Returning 404 to user: Instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:31:16.667782 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-08b106b1-d7d9-4cf8-bbf2-067f70c2e13d tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "DELETE /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 404 len: 111 microversion: 2.20 time: 0.031642 Sep 20 22:31:16.667782 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 430/883] 10.222.0.16 () {60 vars in 1280 bytes} [Tue Sep 20 22:31:16 2022] DELETE /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 20 22:31:16.672381 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9a39c9b4-2331-45e7-b1c0-d608e10c73e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:16.673025 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9a39c9b4-2331-45e7-b1c0-d608e10c73e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 822d0d2c-d682-4143-b1b3-7feeaf3636f7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:16.679530 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9a39c9b4-2331-45e7-b1c0-d608e10c73e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:16.680016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9a39c9b4-2331-45e7-b1c0-d608e10c73e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:16.680454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9a39c9b4-2331-45e7-b1c0-d608e10c73e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:16.681180 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9a39c9b4-2331-45e7-b1c0-d608e10c73e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:16.681638 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9a39c9b4-2331-45e7-b1c0-d608e10c73e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:16.682066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9a39c9b4-2331-45e7-b1c0-d608e10c73e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:16.696696 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-9a39c9b4-2331-45e7-b1c0-d608e10c73e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] HTTP exception thrown: Instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 could not be found. Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9a39c9b4-2331-45e7-b1c0-d608e10c73e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Request method failure captured: Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 HTTP/1.1 Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj18syVDTaZWh7W51ZRKRb7NAdLaqAWn0_TI66AArVf0KyOeVdN9jJ1xQXel-um3xDw7PejpUUXU7wWaNaPTdS5rx_zamPaTjpnWIXNPBQRsMOtA7rMx0UUKlJVF91ITK-vT2WtQeF5k0Uolnnw406Dn4eI5JGv2TjN96CC1qhf2X_Y Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Openstack-Nova-Api-Version: 2.20 Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 897090e72bcc4d978384c95688ab8021 Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-790319658 Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:31:16.698360 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:31:16.700048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/897090e72bcc4d978384c95688ab8021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_897090e72bcc4d978384c95688ab8021", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/897090e72bcc4d978384c95688ab8021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/897090e72bcc4d978384c95688ab8021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:31:16.700048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-AttachVolumeShelveTestJSON-790319658 Sep 20 22:31:16.700048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 897090e72bcc4d978384c95688ab8021 Sep 20 22:31:16.700048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-790319658 Sep 20 22:31:16.700048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-AttachVolumeShelveTestJSON-790319658-project Sep 20 22:31:16.700048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:31:16.700048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:31:16.700048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 69928e19721a455fb614c6f755495449 Sep 20 22:31:16.700048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-AttachVolumeShelveTestJSON-790319658-project Sep 20 22:31:16.700048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:31:16.700048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 could not be found. Sep 20 22:31:16.700048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': '822d0d2c-d682-4143-b1b3-7feeaf3636f7'} Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 could not be found. Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:31:16.701220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:31:16.703235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:31:16.703235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:31:16.703235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:31:16.703235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:31:16.703235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:31:16.703235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:31:16.703235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:31:16.703235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 could not be found. Sep 20 22:31:16.703235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:31:16.703235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:31:16.703235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:31:16.703235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:31:16.703235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:31:16.703235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:31:16.703235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:31:16.703235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:31:16.703235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 could not be found. Sep 20 22:31:16.703235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:31:16.704716 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9a39c9b4-2331-45e7-b1c0-d608e10c73e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Returning 404 to user: Instance 822d0d2c-d682-4143-b1b3-7feeaf3636f7 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:31:16.704716 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-9a39c9b4-2331-45e7-b1c0-d608e10c73e0 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7" status: 404 len: 111 microversion: 2.20 time: 0.031831 Sep 20 22:31:16.704716 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 454/884] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:31:16 2022] GET /compute/v2.1/servers/822d0d2c-d682-4143-b1b3-7feeaf3636f7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 20 22:31:17.839710 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d7255edb-f240-4ed2-816b-c8f5cc06f6e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:17.840213 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d7255edb-f240-4ed2-816b-c8f5cc06f6e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:17.847075 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d7255edb-f240-4ed2-816b-c8f5cc06f6e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:17.847555 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d7255edb-f240-4ed2-816b-c8f5cc06f6e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:17.848069 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d7255edb-f240-4ed2-816b-c8f5cc06f6e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:17.848944 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d7255edb-f240-4ed2-816b-c8f5cc06f6e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:17.850008 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d7255edb-f240-4ed2-816b-c8f5cc06f6e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:17.850445 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d7255edb-f240-4ed2-816b-c8f5cc06f6e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:18.019336 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-d7255edb-f240-4ed2-816b-c8f5cc06f6e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] HTTP exception thrown: Instance 48d58779-65b7-4b97-8536-eef4357a475d could not be found. Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d7255edb-f240-4ed2-816b-c8f5cc06f6e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Request method failure captured: Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: DELETE /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d HTTP/1.1 Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj18syVDTaZWh7W51ZRKRb7NAdLaqAWn0_TI66AArVf0KyOeVdN9jJ1xQXel-um3xDw7PejpUUXU7wWaNaPTdS5rx_zamPaTjpnWIXNPBQRsMOtA7rMx0UUKlJVF91ITK-vT2WtQeF5k0Uolnnw406Dn4eI5JGv2TjN96CC1qhf2X_Y Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Openstack-Nova-Api-Version: 2.20 Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: 897090e72bcc4d978384c95688ab8021 Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-790319658 Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:31:18.020920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:31:18.022603 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/897090e72bcc4d978384c95688ab8021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_897090e72bcc4d978384c95688ab8021", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/897090e72bcc4d978384c95688ab8021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/897090e72bcc4d978384c95688ab8021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:31:18.022603 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-AttachVolumeShelveTestJSON-790319658 Sep 20 22:31:18.022603 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: 897090e72bcc4d978384c95688ab8021 Sep 20 22:31:18.022603 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-790319658 Sep 20 22:31:18.022603 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-AttachVolumeShelveTestJSON-790319658-project Sep 20 22:31:18.022603 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:31:18.022603 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:31:18.022603 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 69928e19721a455fb614c6f755495449 Sep 20 22:31:18.022603 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-AttachVolumeShelveTestJSON-790319658-project Sep 20 22:31:18.022603 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:31:18.022603 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance 48d58779-65b7-4b97-8536-eef4357a475d could not be found. Sep 20 22:31:18.022603 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': '48d58779-65b7-4b97-8536-eef4357a475d'} Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d58779-65b7-4b97-8536-eef4357a475d could not be found. Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:31:18.023427 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d58779-65b7-4b97-8536-eef4357a475d could not be found. Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d58779-65b7-4b97-8536-eef4357a475d could not be found. Sep 20 22:31:18.024636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:31:18.025928 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d7255edb-f240-4ed2-816b-c8f5cc06f6e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Returning 404 to user: Instance 48d58779-65b7-4b97-8536-eef4357a475d could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:31:18.025928 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-d7255edb-f240-4ed2-816b-c8f5cc06f6e4 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "DELETE /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 404 len: 111 microversion: 2.20 time: 0.186754 Sep 20 22:31:18.025928 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 431/885] 10.222.0.16 () {60 vars in 1280 bytes} [Tue Sep 20 22:31:17 2022] DELETE /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 20 22:31:18.032039 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c124df14-6ae7-4af8-8963-13a6074bbef1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:18.032706 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-c124df14-6ae7-4af8-8963-13a6074bbef1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] [instance: 48d58779-65b7-4b97-8536-eef4357a475d] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:18.038937 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c124df14-6ae7-4af8-8963-13a6074bbef1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:18.039415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c124df14-6ae7-4af8-8963-13a6074bbef1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:18.039845 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c124df14-6ae7-4af8-8963-13a6074bbef1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:18.041042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c124df14-6ae7-4af8-8963-13a6074bbef1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:18.041504 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c124df14-6ae7-4af8-8963-13a6074bbef1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:18.041926 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c124df14-6ae7-4af8-8963-13a6074bbef1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:18.055567 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-c124df14-6ae7-4af8-8963-13a6074bbef1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] HTTP exception thrown: Instance 48d58779-65b7-4b97-8536-eef4357a475d could not be found. Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c124df14-6ae7-4af8-8963-13a6074bbef1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Request method failure captured: Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d HTTP/1.1 Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj18syVDTaZWh7W51ZRKRb7NAdLaqAWn0_TI66AArVf0KyOeVdN9jJ1xQXel-um3xDw7PejpUUXU7wWaNaPTdS5rx_zamPaTjpnWIXNPBQRsMOtA7rMx0UUKlJVF91ITK-vT2WtQeF5k0Uolnnw406Dn4eI5JGv2TjN96CC1qhf2X_Y Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Openstack-Nova-Api-Version: 2.20 Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 897090e72bcc4d978384c95688ab8021 Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-790319658 Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:31:18.057163 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:31:18.058821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/897090e72bcc4d978384c95688ab8021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_897090e72bcc4d978384c95688ab8021", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/897090e72bcc4d978384c95688ab8021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/897090e72bcc4d978384c95688ab8021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:31:18.058821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-AttachVolumeShelveTestJSON-790319658 Sep 20 22:31:18.058821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 897090e72bcc4d978384c95688ab8021 Sep 20 22:31:18.058821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-790319658 Sep 20 22:31:18.058821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-AttachVolumeShelveTestJSON-790319658-project Sep 20 22:31:18.058821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:31:18.058821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:31:18.058821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 69928e19721a455fb614c6f755495449 Sep 20 22:31:18.058821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-AttachVolumeShelveTestJSON-790319658-project Sep 20 22:31:18.058821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:31:18.058821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance 48d58779-65b7-4b97-8536-eef4357a475d could not be found. Sep 20 22:31:18.058821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': '48d58779-65b7-4b97-8536-eef4357a475d'} Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d58779-65b7-4b97-8536-eef4357a475d could not be found. Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:31:18.063206 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:31:18.064665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:31:18.064665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:31:18.064665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:31:18.064665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:31:18.064665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:31:18.064665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:31:18.064665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:31:18.064665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d58779-65b7-4b97-8536-eef4357a475d could not be found. Sep 20 22:31:18.064665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:31:18.064665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:31:18.064665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:31:18.064665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:31:18.064665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:31:18.064665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:31:18.064665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:31:18.064665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:31:18.064665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d58779-65b7-4b97-8536-eef4357a475d could not be found. Sep 20 22:31:18.064665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:31:18.066016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c124df14-6ae7-4af8-8963-13a6074bbef1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] Returning 404 to user: Instance 48d58779-65b7-4b97-8536-eef4357a475d could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:31:18.066016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c124df14-6ae7-4af8-8963-13a6074bbef1 tempest-AttachVolumeShelveTestJSON-790319658 tempest-AttachVolumeShelveTestJSON-790319658-project] 10.222.0.16 "GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d" status: 404 len: 111 microversion: 2.20 time: 0.031296 Sep 20 22:31:18.066016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 455/886] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 20 22:31:18 2022] GET /compute/v2.1/servers/48d58779-65b7-4b97-8536-eef4357a475d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 20 22:31:19.136129 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-13e5a8c7-53e8-4ade-a4f6-dea9efdefe93 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:19.137017 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-13e5a8c7-53e8-4ade-a4f6-dea9efdefe93 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:19.145419 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-13e5a8c7-53e8-4ade-a4f6-dea9efdefe93 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:19.146003 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-13e5a8c7-53e8-4ade-a4f6-dea9efdefe93 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:19.146625 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-13e5a8c7-53e8-4ade-a4f6-dea9efdefe93 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:19.147724 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-13e5a8c7-53e8-4ade-a4f6-dea9efdefe93 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:19.148347 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-13e5a8c7-53e8-4ade-a4f6-dea9efdefe93 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:19.148931 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-13e5a8c7-53e8-4ade-a4f6-dea9efdefe93 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:19.350378 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-13e5a8c7-53e8-4ade-a4f6-dea9efdefe93 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:19.359507 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-13e5a8c7-53e8-4ade-a4f6-dea9efdefe93 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1593 microversion: 2.1 time: 0.227719 Sep 20 22:31:19.360223 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 432/887] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:19 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1593 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:22.154582 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-e8895f18-f1c0-4188-9c29-6eb4214bca1b req-813b6081-7d5b-4bb4-8bf6-af6a5d060d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c51ac84a-e21e-470f-b1c4-c542a1b8f553", "tag": "2c27dc78-c19b-4ad9-b5ae-35688f10f1a8"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:31:22.165987 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=2 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:22.168010 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-e8895f18-f1c0-4188-9c29-6eb4214bca1b req-813b6081-7d5b-4bb4-8bf6-af6a5d060d63 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:22.168497 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-e8895f18-f1c0-4188-9c29-6eb4214bca1b req-813b6081-7d5b-4bb4-8bf6-af6a5d060d63 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:22.169071 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-e8895f18-f1c0-4188-9c29-6eb4214bca1b req-813b6081-7d5b-4bb4-8bf6-af6a5d060d63 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:22.192042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-e8895f18-f1c0-4188-9c29-6eb4214bca1b req-813b6081-7d5b-4bb4-8bf6-af6a5d060d63 service nova] Creating event network-changed:2c27dc78-c19b-4ad9-b5ae-35688f10f1a8 for instance c51ac84a-e21e-470f-b1c4-c542a1b8f553 on hv-cinder-85827 Sep 20 22:31:22.205408 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-e8895f18-f1c0-4188-9c29-6eb4214bca1b req-813b6081-7d5b-4bb4-8bf6-af6a5d060d63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054950 Sep 20 22:31:22.209753 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 456/888] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:31:23.749691 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-470b26cf-4d15-4782-b782-832a010e8eb8 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1749188434"}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:31:23.750201 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-470b26cf-4d15-4782-b782-832a010e8eb8 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:23.756888 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-470b26cf-4d15-4782-b782-832a010e8eb8 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:23.757953 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-470b26cf-4d15-4782-b782-832a010e8eb8 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:23.758557 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-470b26cf-4d15-4782-b782-832a010e8eb8 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:23.759614 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-470b26cf-4d15-4782-b782-832a010e8eb8 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:23.760592 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-470b26cf-4d15-4782-b782-832a010e8eb8 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:23.761308 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-470b26cf-4d15-4782-b782-832a010e8eb8 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:23.897768 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.network.security_group_api [None req-470b26cf-4d15-4782-b782-832a010e8eb8 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Adding security group 900f5927-f727-4010-8262-9cabbc02c542 to port 2c27dc78-c19b-4ad9-b5ae-35688f10f1a8 Sep 20 22:31:24.548038 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-470b26cf-4d15-4782-b782-832a010e8eb8 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "POST /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553/action" status: 202 len: 0 microversion: 2.1 time: 0.802879 Sep 20 22:31:24.548689 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 433/889] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 20 22:31:23 2022] POST /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553/action => generated 0 bytes in 804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 20 22:31:24.561769 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-82d7b4c7-546b-47db-9adf-d07f023d9c4d req-0226cdc8-8ae7-45f7-958b-1dc388c84888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c51ac84a-e21e-470f-b1c4-c542a1b8f553", "tag": "2c27dc78-c19b-4ad9-b5ae-35688f10f1a8"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:31:24.566103 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-2f603365-6696-420f-a68c-19c2962ed8a7 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:24.568084 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-2f603365-6696-420f-a68c-19c2962ed8a7 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:24.582392 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2f603365-6696-420f-a68c-19c2962ed8a7 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:24.587920 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2f603365-6696-420f-a68c-19c2962ed8a7 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:24.588605 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2f603365-6696-420f-a68c-19c2962ed8a7 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:24.590148 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-82d7b4c7-546b-47db-9adf-d07f023d9c4d req-0226cdc8-8ae7-45f7-958b-1dc388c84888 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:24.591078 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2f603365-6696-420f-a68c-19c2962ed8a7 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:24.591759 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2f603365-6696-420f-a68c-19c2962ed8a7 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:24.593402 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2f603365-6696-420f-a68c-19c2962ed8a7 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:24.593729 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-82d7b4c7-546b-47db-9adf-d07f023d9c4d req-0226cdc8-8ae7-45f7-958b-1dc388c84888 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:24.594210 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-82d7b4c7-546b-47db-9adf-d07f023d9c4d req-0226cdc8-8ae7-45f7-958b-1dc388c84888 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:24.631231 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-82d7b4c7-546b-47db-9adf-d07f023d9c4d req-0226cdc8-8ae7-45f7-958b-1dc388c84888 service nova] Creating event network-changed:2c27dc78-c19b-4ad9-b5ae-35688f10f1a8 for instance c51ac84a-e21e-470f-b1c4-c542a1b8f553 on hv-cinder-85827 Sep 20 22:31:24.641449 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-82d7b4c7-546b-47db-9adf-d07f023d9c4d req-0226cdc8-8ae7-45f7-958b-1dc388c84888 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083155 Sep 20 22:31:24.642798 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 434/890] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:31:25.088161 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-2f603365-6696-420f-a68c-19c2962ed8a7 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:25.098902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-2f603365-6696-420f-a68c-19c2962ed8a7 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1759 microversion: 2.1 time: 0.545613 Sep 20 22:31:25.099995 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 457/891] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:24 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1759 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:28.665984 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6ec19626-dfe4-4bee-9beb-29258ee0cba4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Action: 'create', calling method: .version_select at 0x7f24f67178b0>, body: {"keypair": {"name": "tempest-keypair-1585712580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVwLVQ9GWLgF5u91rU2ON+vRXTTbeJdXzv0zWaPEGohMNCp3Zoh3kodNcMdZNPlRG/x/tNBQHxOVrJg/6K/AAl9XQq3Liu7nPR0gL8nBa0anoy7mINmwtRFrFbm7d9O8w=="}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:31:28.672603 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:28.688034 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-6ec19626-dfe4-4bee-9beb-29258ee0cba4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Getting quotas for project 59af02f2b4984c6190870041aa020d75. Resources: {'key_pairs'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:31:28.692478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-6ec19626-dfe4-4bee-9beb-29258ee0cba4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Getting quotas for user 4af67f949fda43bf8967925f04491bd8 and project 59af02f2b4984c6190870041aa020d75. Resources: {'key_pairs'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:31:28.715968 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-6ec19626-dfe4-4bee-9beb-29258ee0cba4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.178623 Sep 20 22:31:28.716563 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 435/892] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 20 22:31:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:31:30.088582 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-8ac72da7-7ace-4c83-902e-6f5be8370854 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1031620929", "imageRef": "a1be001e-c2e4-44b7-b0d2-af96de3855c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fdd6da27-ff07-48de-8020-aad44ec6dade"}], "security_groups": [{"name": "tempest-securitygroup--1657663637"}], "key_name": "tempest-keypair-1585712580", "user_data": "}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:31:30.208766 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.network.neutron [None req-8ac72da7-7ace-4c83-902e-6f5be8370854 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] validate_networks() for [('fdd6da27-ff07-48de-8020-aad44ec6dade', None, None, None, None, None)] {{(pid=120474) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:31:30.610801 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-8ac72da7-7ace-4c83-902e-6f5be8370854 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Flavor limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:31:30.611248 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-8ac72da7-7ace-4c83-902e-6f5be8370854 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Image limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:31:30.612539 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-8ac72da7-7ace-4c83-902e-6f5be8370854 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Flavor pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:31:30.612539 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-8ac72da7-7ace-4c83-902e-6f5be8370854 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Image pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:31:30.612755 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-8ac72da7-7ace-4c83-902e-6f5be8370854 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:31:30.622459 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8ac72da7-7ace-4c83-902e-6f5be8370854 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:30.622941 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8ac72da7-7ace-4c83-902e-6f5be8370854 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:30.623369 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8ac72da7-7ace-4c83-902e-6f5be8370854 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:30.624080 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8ac72da7-7ace-4c83-902e-6f5be8370854 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:30.624527 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8ac72da7-7ace-4c83-902e-6f5be8370854 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:30.624948 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8ac72da7-7ace-4c83-902e-6f5be8370854 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:30.631893 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=73 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:30.642660 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-8ac72da7-7ace-4c83-902e-6f5be8370854 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Getting quotas for project 59af02f2b4984c6190870041aa020d75. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:31:30.646543 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-8ac72da7-7ace-4c83-902e-6f5be8370854 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Getting quotas for user 4af67f949fda43bf8967925f04491bd8 and project 59af02f2b4984c6190870041aa020d75. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:31:30.658110 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-8ac72da7-7ace-4c83-902e-6f5be8370854 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Going to run 1 instances... {{(pid=120474) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:31:30.660407 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-8ac72da7-7ace-4c83-902e-6f5be8370854 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a1be001e-c2e4-44b7-b0d2-af96de3855c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:31:30.706811 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-8ac72da7-7ace-4c83-902e-6f5be8370854 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.622682 Sep 20 22:31:30.707764 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 458/893] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:31:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 22:31:30.719203 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-9813baf3-85af-4b4c-9259-a54bc7925208 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:30.720759 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-9813baf3-85af-4b4c-9259-a54bc7925208 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:30.789784 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-9813baf3-85af-4b4c-9259-a54bc7925208 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:30.798029 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-9813baf3-85af-4b4c-9259-a54bc7925208 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960" status: 200 len: 1242 microversion: 2.1 time: 0.083160 Sep 20 22:31:30.800302 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 436/894] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:30 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:31.821876 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-cb141360-ca53-44b2-bfc7-f3c45c4ff1d8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:31.822496 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-cb141360-ca53-44b2-bfc7-f3c45c4ff1d8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:31.835521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cb141360-ca53-44b2-bfc7-f3c45c4ff1d8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:31.836372 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cb141360-ca53-44b2-bfc7-f3c45c4ff1d8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:31.836905 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cb141360-ca53-44b2-bfc7-f3c45c4ff1d8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:31.837885 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cb141360-ca53-44b2-bfc7-f3c45c4ff1d8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:31.838584 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cb141360-ca53-44b2-bfc7-f3c45c4ff1d8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:31.839013 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cb141360-ca53-44b2-bfc7-f3c45c4ff1d8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:32.000112 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-cb141360-ca53-44b2-bfc7-f3c45c4ff1d8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:32.015100 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-cb141360-ca53-44b2-bfc7-f3c45c4ff1d8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960" status: 200 len: 1302 microversion: 2.1 time: 0.197449 Sep 20 22:31:32.037293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 459/895] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:31 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 => generated 1302 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:33.047861 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ab9caef3-913e-4345-8f83-c3ee1cfbbf50 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:33.048584 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ab9caef3-913e-4345-8f83-c3ee1cfbbf50 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:33.055249 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ab9caef3-913e-4345-8f83-c3ee1cfbbf50 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:33.055809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ab9caef3-913e-4345-8f83-c3ee1cfbbf50 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:33.056482 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ab9caef3-913e-4345-8f83-c3ee1cfbbf50 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:33.057288 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ab9caef3-913e-4345-8f83-c3ee1cfbbf50 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:33.057812 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ab9caef3-913e-4345-8f83-c3ee1cfbbf50 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:33.058304 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ab9caef3-913e-4345-8f83-c3ee1cfbbf50 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:33.062422 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:33.192031 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ab9caef3-913e-4345-8f83-c3ee1cfbbf50 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:33.199716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ab9caef3-913e-4345-8f83-c3ee1cfbbf50 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960" status: 200 len: 1368 microversion: 2.1 time: 0.156357 Sep 20 22:31:33.200202 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 437/896] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:33 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:33.650742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-d1169274-47d1-4af3-9848-7a9e0dfb75a9 req-d9a4f000-cb8b-47f7-b0fb-c64ed2a6d282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef067608-a015-4521-8a76-e5aeba165960", "tag": "3c925cd1-3b42-4284-9099-5cce9585f55e"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:31:33.663196 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-d1169274-47d1-4af3-9848-7a9e0dfb75a9 req-d9a4f000-cb8b-47f7-b0fb-c64ed2a6d282 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:33.663715 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-d1169274-47d1-4af3-9848-7a9e0dfb75a9 req-d9a4f000-cb8b-47f7-b0fb-c64ed2a6d282 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:33.664187 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-d1169274-47d1-4af3-9848-7a9e0dfb75a9 req-d9a4f000-cb8b-47f7-b0fb-c64ed2a6d282 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:33.677209 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-d1169274-47d1-4af3-9848-7a9e0dfb75a9 req-d9a4f000-cb8b-47f7-b0fb-c64ed2a6d282 service nova] Creating event network-changed:3c925cd1-3b42-4284-9099-5cce9585f55e for instance ef067608-a015-4521-8a76-e5aeba165960 on hv-cinder-85827 Sep 20 22:31:33.682193 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-d1169274-47d1-4af3-9848-7a9e0dfb75a9 req-d9a4f000-cb8b-47f7-b0fb-c64ed2a6d282 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035268 Sep 20 22:31:33.682785 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 460/897] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:31:34.223817 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c88239fb-d624-4a3c-8450-746e29fd8132 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:34.224461 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c88239fb-d624-4a3c-8450-746e29fd8132 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:34.230911 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c88239fb-d624-4a3c-8450-746e29fd8132 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:34.231392 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c88239fb-d624-4a3c-8450-746e29fd8132 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:34.231828 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c88239fb-d624-4a3c-8450-746e29fd8132 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:34.233156 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c88239fb-d624-4a3c-8450-746e29fd8132 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:34.233672 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c88239fb-d624-4a3c-8450-746e29fd8132 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:34.234048 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c88239fb-d624-4a3c-8450-746e29fd8132 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:34.357227 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c88239fb-d624-4a3c-8450-746e29fd8132 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:34.365338 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-c88239fb-d624-4a3c-8450-746e29fd8132 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960" status: 200 len: 1368 microversion: 2.1 time: 0.145374 Sep 20 22:31:34.365926 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 438/898] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:34 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:35.389082 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-597a262c-b2e3-4e89-96d2-ef86bd87b94b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:35.389798 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-597a262c-b2e3-4e89-96d2-ef86bd87b94b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:35.395940 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-597a262c-b2e3-4e89-96d2-ef86bd87b94b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:35.396426 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-597a262c-b2e3-4e89-96d2-ef86bd87b94b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:35.396860 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-597a262c-b2e3-4e89-96d2-ef86bd87b94b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:35.397575 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-597a262c-b2e3-4e89-96d2-ef86bd87b94b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:35.398035 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-597a262c-b2e3-4e89-96d2-ef86bd87b94b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:35.398459 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-597a262c-b2e3-4e89-96d2-ef86bd87b94b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:35.604170 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-597a262c-b2e3-4e89-96d2-ef86bd87b94b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:35.612705 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-597a262c-b2e3-4e89-96d2-ef86bd87b94b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960" status: 200 len: 1368 microversion: 2.1 time: 0.228720 Sep 20 22:31:35.613318 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 461/899] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:35 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:36.635789 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-f5f98f38-54ae-4f05-a1a0-5ee68be29477 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:36.636398 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-f5f98f38-54ae-4f05-a1a0-5ee68be29477 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:36.643032 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f5f98f38-54ae-4f05-a1a0-5ee68be29477 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:36.643519 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f5f98f38-54ae-4f05-a1a0-5ee68be29477 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:36.644456 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f5f98f38-54ae-4f05-a1a0-5ee68be29477 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:36.645031 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f5f98f38-54ae-4f05-a1a0-5ee68be29477 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:36.645521 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f5f98f38-54ae-4f05-a1a0-5ee68be29477 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:36.646136 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-f5f98f38-54ae-4f05-a1a0-5ee68be29477 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:36.782450 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-f5f98f38-54ae-4f05-a1a0-5ee68be29477 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:36.790075 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-f5f98f38-54ae-4f05-a1a0-5ee68be29477 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960" status: 200 len: 1368 microversion: 2.1 time: 0.158184 Sep 20 22:31:36.790627 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 439/900] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:36 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:37.121202 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-ec9a6f6e-b837-477e-b964-8b1c97b3d489 req-c99ea426-5a6f-4e81-8ab0-16ab91cf5866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef067608-a015-4521-8a76-e5aeba165960", "name": "network-vif-plugged", "status": "completed", "tag": "3c925cd1-3b42-4284-9099-5cce9585f55e"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:31:37.131556 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-ec9a6f6e-b837-477e-b964-8b1c97b3d489 req-c99ea426-5a6f-4e81-8ab0-16ab91cf5866 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:37.132172 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-ec9a6f6e-b837-477e-b964-8b1c97b3d489 req-c99ea426-5a6f-4e81-8ab0-16ab91cf5866 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:37.132590 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-ec9a6f6e-b837-477e-b964-8b1c97b3d489 req-c99ea426-5a6f-4e81-8ab0-16ab91cf5866 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:37.144060 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-ec9a6f6e-b837-477e-b964-8b1c97b3d489 req-c99ea426-5a6f-4e81-8ab0-16ab91cf5866 service nova] Creating event network-vif-plugged:3c925cd1-3b42-4284-9099-5cce9585f55e for instance ef067608-a015-4521-8a76-e5aeba165960 on hv-cinder-85827 Sep 20 22:31:37.148854 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-ec9a6f6e-b837-477e-b964-8b1c97b3d489 req-c99ea426-5a6f-4e81-8ab0-16ab91cf5866 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031566 Sep 20 22:31:37.149593 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 462/901] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:31:37.813694 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ce65295d-b99d-4aeb-b6b5-bc0e27dc7552 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:37.814498 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ce65295d-b99d-4aeb-b6b5-bc0e27dc7552 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:37.821152 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ce65295d-b99d-4aeb-b6b5-bc0e27dc7552 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:37.822055 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ce65295d-b99d-4aeb-b6b5-bc0e27dc7552 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:37.822538 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ce65295d-b99d-4aeb-b6b5-bc0e27dc7552 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:37.823296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ce65295d-b99d-4aeb-b6b5-bc0e27dc7552 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:37.823785 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ce65295d-b99d-4aeb-b6b5-bc0e27dc7552 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:37.824373 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ce65295d-b99d-4aeb-b6b5-bc0e27dc7552 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:37.967860 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ce65295d-b99d-4aeb-b6b5-bc0e27dc7552 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:37.975421 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ce65295d-b99d-4aeb-b6b5-bc0e27dc7552 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960" status: 200 len: 1368 microversion: 2.1 time: 0.166445 Sep 20 22:31:37.975979 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 440/902] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:37 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:38.999388 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-20b967ee-4200-425c-842e-2e78d1f12c44 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:39.000085 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-20b967ee-4200-425c-842e-2e78d1f12c44 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:39.006100 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-20b967ee-4200-425c-842e-2e78d1f12c44 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:39.006577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-20b967ee-4200-425c-842e-2e78d1f12c44 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:39.007006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-20b967ee-4200-425c-842e-2e78d1f12c44 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:39.007686 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-20b967ee-4200-425c-842e-2e78d1f12c44 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:39.008134 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-20b967ee-4200-425c-842e-2e78d1f12c44 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:39.008561 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-20b967ee-4200-425c-842e-2e78d1f12c44 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:39.140698 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-20b967ee-4200-425c-842e-2e78d1f12c44 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:39.148272 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-20b967ee-4200-425c-842e-2e78d1f12c44 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960" status: 200 len: 1368 microversion: 2.1 time: 0.153922 Sep 20 22:31:39.148858 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 463/903] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:38 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:40.171868 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-2d23ece5-8835-4c88-b1ee-11daa557b2e8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:40.172493 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-2d23ece5-8835-4c88-b1ee-11daa557b2e8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:40.179001 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2d23ece5-8835-4c88-b1ee-11daa557b2e8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:40.179485 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2d23ece5-8835-4c88-b1ee-11daa557b2e8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:40.179922 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2d23ece5-8835-4c88-b1ee-11daa557b2e8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:40.180614 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2d23ece5-8835-4c88-b1ee-11daa557b2e8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:40.181100 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2d23ece5-8835-4c88-b1ee-11daa557b2e8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:40.181530 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2d23ece5-8835-4c88-b1ee-11daa557b2e8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:40.308614 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-2d23ece5-8835-4c88-b1ee-11daa557b2e8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:40.316091 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-2d23ece5-8835-4c88-b1ee-11daa557b2e8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960" status: 200 len: 1368 microversion: 2.1 time: 0.148649 Sep 20 22:31:40.316648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 441/904] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:40 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:41.338622 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-7ca46734-c930-44be-b358-2aa1f543eac3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:41.339210 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-7ca46734-c930-44be-b358-2aa1f543eac3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:41.341565 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=2 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:41.342805 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=6 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:41.349685 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7ca46734-c930-44be-b358-2aa1f543eac3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:41.350239 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7ca46734-c930-44be-b358-2aa1f543eac3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:41.350679 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7ca46734-c930-44be-b358-2aa1f543eac3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:41.351552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7ca46734-c930-44be-b358-2aa1f543eac3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:41.352021 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7ca46734-c930-44be-b358-2aa1f543eac3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:41.352443 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7ca46734-c930-44be-b358-2aa1f543eac3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:41.482662 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-7ca46734-c930-44be-b358-2aa1f543eac3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:31:41.490405 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-7ca46734-c930-44be-b358-2aa1f543eac3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960" status: 200 len: 1558 microversion: 2.1 time: 0.155774 Sep 20 22:31:41.490967 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 464/905] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:31:41 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:31:41.513047 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-7b47a64e-a134-4ded-8f61-5999313f4728 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:31:41.514062 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-7b47a64e-a134-4ded-8f61-5999313f4728 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:31:41.515909 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=6 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:41.521597 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7b47a64e-a134-4ded-8f61-5999313f4728 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:41.522069 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7b47a64e-a134-4ded-8f61-5999313f4728 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:41.522500 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7b47a64e-a134-4ded-8f61-5999313f4728 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:41.523181 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7b47a64e-a134-4ded-8f61-5999313f4728 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:41.523625 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7b47a64e-a134-4ded-8f61-5999313f4728 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:41.524044 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7b47a64e-a134-4ded-8f61-5999313f4728 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:41.603096 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-7b47a64e-a134-4ded-8f61-5999313f4728 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093893 Sep 20 22:31:41.603680 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 442/906] 10.222.0.16 () {58 vars in 1275 bytes} [Tue Sep 20 22:31:41 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:31:42.554317 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-b481571d-5914-402f-a731-90aa5ffa9e76 req-a60bcc04-f28f-4c11-ab21-4163c683dbf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef067608-a015-4521-8a76-e5aeba165960", "tag": "3c925cd1-3b42-4284-9099-5cce9585f55e"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:31:42.563950 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-b481571d-5914-402f-a731-90aa5ffa9e76 req-a60bcc04-f28f-4c11-ab21-4163c683dbf2 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:31:42.564428 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-b481571d-5914-402f-a731-90aa5ffa9e76 req-a60bcc04-f28f-4c11-ab21-4163c683dbf2 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:31:42.564855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-b481571d-5914-402f-a731-90aa5ffa9e76 req-a60bcc04-f28f-4c11-ab21-4163c683dbf2 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:31:42.575591 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-b481571d-5914-402f-a731-90aa5ffa9e76 req-a60bcc04-f28f-4c11-ab21-4163c683dbf2 service nova] Creating event network-changed:3c925cd1-3b42-4284-9099-5cce9585f55e for instance ef067608-a015-4521-8a76-e5aeba165960 on hv-cinder-85827 Sep 20 22:31:42.582281 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-b481571d-5914-402f-a731-90aa5ffa9e76 req-a60bcc04-f28f-4c11-ab21-4163c683dbf2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031535 Sep 20 22:31:42.583287 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 465/907] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:32:02.517453 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:02.518263 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=33 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:02.522287 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-779e5b33-ac67-4425-b67e-c58624480b5a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:32:02.524573 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-779e5b33-ac67-4425-b67e-c58624480b5a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:02.531955 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-779e5b33-ac67-4425-b67e-c58624480b5a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:02.532429 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-779e5b33-ac67-4425-b67e-c58624480b5a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:02.532857 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-779e5b33-ac67-4425-b67e-c58624480b5a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:02.533563 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-779e5b33-ac67-4425-b67e-c58624480b5a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:02.534011 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-779e5b33-ac67-4425-b67e-c58624480b5a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:02.534428 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-779e5b33-ac67-4425-b67e-c58624480b5a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:02.603293 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-779e5b33-ac67-4425-b67e-c58624480b5a tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "POST /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553/action" status: 202 len: 0 microversion: 2.1 time: 0.086937 Sep 20 22:32:02.603982 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 443/908] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 20 22:32:02 2022] POST /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:32:02.610169 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:02.610916 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=31 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:02.615294 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ef1cebdc-ff8c-489c-b5d7-cb99e589c98c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:02.615989 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ef1cebdc-ff8c-489c-b5d7-cb99e589c98c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:02.624038 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ef1cebdc-ff8c-489c-b5d7-cb99e589c98c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:02.624529 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ef1cebdc-ff8c-489c-b5d7-cb99e589c98c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:02.624960 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ef1cebdc-ff8c-489c-b5d7-cb99e589c98c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:02.625689 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ef1cebdc-ff8c-489c-b5d7-cb99e589c98c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:02.626155 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ef1cebdc-ff8c-489c-b5d7-cb99e589c98c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:02.626555 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ef1cebdc-ff8c-489c-b5d7-cb99e589c98c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:02.852096 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ef1cebdc-ff8c-489c-b5d7-cb99e589c98c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:02.865901 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ef1cebdc-ff8c-489c-b5d7-cb99e589c98c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1751 microversion: 2.1 time: 0.252846 Sep 20 22:32:02.865901 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 466/909] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:02 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1751 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:03.886790 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-daa22e6b-4f9b-462b-a8ef-79bd1663d704 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:03.887569 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-daa22e6b-4f9b-462b-a8ef-79bd1663d704 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:03.894244 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-daa22e6b-4f9b-462b-a8ef-79bd1663d704 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:03.894725 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-daa22e6b-4f9b-462b-a8ef-79bd1663d704 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:03.895171 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-daa22e6b-4f9b-462b-a8ef-79bd1663d704 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:03.895859 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-daa22e6b-4f9b-462b-a8ef-79bd1663d704 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:03.896317 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-daa22e6b-4f9b-462b-a8ef-79bd1663d704 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:03.896738 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-daa22e6b-4f9b-462b-a8ef-79bd1663d704 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:04.060722 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-daa22e6b-4f9b-462b-a8ef-79bd1663d704 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:04.069260 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-daa22e6b-4f9b-462b-a8ef-79bd1663d704 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1756 microversion: 2.1 time: 0.187174 Sep 20 22:32:04.069873 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 444/910] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:03 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:05.093606 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f39967d8-66bb-48a1-9ff3-fe344a80ed8d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:05.094210 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-f39967d8-66bb-48a1-9ff3-fe344a80ed8d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:05.100519 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f39967d8-66bb-48a1-9ff3-fe344a80ed8d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:05.101026 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f39967d8-66bb-48a1-9ff3-fe344a80ed8d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:05.101459 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f39967d8-66bb-48a1-9ff3-fe344a80ed8d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:05.102146 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f39967d8-66bb-48a1-9ff3-fe344a80ed8d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:05.102593 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f39967d8-66bb-48a1-9ff3-fe344a80ed8d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:05.103010 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f39967d8-66bb-48a1-9ff3-fe344a80ed8d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:05.250658 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-f39967d8-66bb-48a1-9ff3-fe344a80ed8d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:05.258849 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-f39967d8-66bb-48a1-9ff3-fe344a80ed8d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1756 microversion: 2.1 time: 0.169604 Sep 20 22:32:05.259412 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 467/911] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:05 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:06.282250 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-75e524ca-4634-44e1-ba07-76627b41584d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:06.282867 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-75e524ca-4634-44e1-ba07-76627b41584d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:06.289532 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-75e524ca-4634-44e1-ba07-76627b41584d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:06.290021 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-75e524ca-4634-44e1-ba07-76627b41584d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:06.290485 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-75e524ca-4634-44e1-ba07-76627b41584d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:06.291184 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-75e524ca-4634-44e1-ba07-76627b41584d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:06.291637 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-75e524ca-4634-44e1-ba07-76627b41584d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:06.292061 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-75e524ca-4634-44e1-ba07-76627b41584d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:06.434491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-75e524ca-4634-44e1-ba07-76627b41584d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:06.442588 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-75e524ca-4634-44e1-ba07-76627b41584d tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1756 microversion: 2.1 time: 0.164224 Sep 20 22:32:06.443158 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 445/912] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:06 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:07.465302 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-336a30f1-ca9b-48e9-8e35-044cf224aeea tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:07.465917 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-336a30f1-ca9b-48e9-8e35-044cf224aeea tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:07.472824 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-336a30f1-ca9b-48e9-8e35-044cf224aeea tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:07.473346 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-336a30f1-ca9b-48e9-8e35-044cf224aeea tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:07.473781 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-336a30f1-ca9b-48e9-8e35-044cf224aeea tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:07.474463 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-336a30f1-ca9b-48e9-8e35-044cf224aeea tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:07.474967 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-336a30f1-ca9b-48e9-8e35-044cf224aeea tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:07.475389 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-336a30f1-ca9b-48e9-8e35-044cf224aeea tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:07.611544 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-336a30f1-ca9b-48e9-8e35-044cf224aeea tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:07.619888 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-336a30f1-ca9b-48e9-8e35-044cf224aeea tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1756 microversion: 2.1 time: 0.158362 Sep 20 22:32:07.620410 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 468/913] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:07 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:08.644040 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-5d224877-7266-4ab2-979d-16523e39acc5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:08.644660 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-5d224877-7266-4ab2-979d-16523e39acc5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:08.651047 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5d224877-7266-4ab2-979d-16523e39acc5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:08.651532 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5d224877-7266-4ab2-979d-16523e39acc5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:08.651968 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5d224877-7266-4ab2-979d-16523e39acc5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:08.652664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5d224877-7266-4ab2-979d-16523e39acc5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:08.653174 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5d224877-7266-4ab2-979d-16523e39acc5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:08.653607 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5d224877-7266-4ab2-979d-16523e39acc5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:08.795822 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-5d224877-7266-4ab2-979d-16523e39acc5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:08.804350 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-5d224877-7266-4ab2-979d-16523e39acc5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1756 microversion: 2.1 time: 0.164210 Sep 20 22:32:08.804959 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 446/914] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:08 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:09.827848 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-8ca5b57d-f3c9-441e-ac55-a635db6ee3cc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:09.828382 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-8ca5b57d-f3c9-441e-ac55-a635db6ee3cc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:09.834811 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8ca5b57d-f3c9-441e-ac55-a635db6ee3cc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:09.835291 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8ca5b57d-f3c9-441e-ac55-a635db6ee3cc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:09.835722 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8ca5b57d-f3c9-441e-ac55-a635db6ee3cc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:09.836407 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8ca5b57d-f3c9-441e-ac55-a635db6ee3cc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:09.836858 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8ca5b57d-f3c9-441e-ac55-a635db6ee3cc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:09.837306 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8ca5b57d-f3c9-441e-ac55-a635db6ee3cc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:09.977861 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-8ca5b57d-f3c9-441e-ac55-a635db6ee3cc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:09.986067 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-8ca5b57d-f3c9-441e-ac55-a635db6ee3cc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1756 microversion: 2.1 time: 0.162765 Sep 20 22:32:09.986706 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 469/915] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:09 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:11.009378 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a015ffc1-5bf9-4f22-a1e9-3a5f3212f3e2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:11.009918 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a015ffc1-5bf9-4f22-a1e9-3a5f3212f3e2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:11.016314 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a015ffc1-5bf9-4f22-a1e9-3a5f3212f3e2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:11.016779 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a015ffc1-5bf9-4f22-a1e9-3a5f3212f3e2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:11.017250 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a015ffc1-5bf9-4f22-a1e9-3a5f3212f3e2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:11.017938 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a015ffc1-5bf9-4f22-a1e9-3a5f3212f3e2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:11.018393 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a015ffc1-5bf9-4f22-a1e9-3a5f3212f3e2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:11.018814 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a015ffc1-5bf9-4f22-a1e9-3a5f3212f3e2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:11.155806 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a015ffc1-5bf9-4f22-a1e9-3a5f3212f3e2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:11.163882 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a015ffc1-5bf9-4f22-a1e9-3a5f3212f3e2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1756 microversion: 2.1 time: 0.158566 Sep 20 22:32:11.164443 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 447/916] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:11 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:12.188140 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-95bf8ec7-a769-4362-b7e3-2f55ba89ec34 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:12.188746 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-95bf8ec7-a769-4362-b7e3-2f55ba89ec34 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:12.195130 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-95bf8ec7-a769-4362-b7e3-2f55ba89ec34 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:12.195605 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-95bf8ec7-a769-4362-b7e3-2f55ba89ec34 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:12.196043 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-95bf8ec7-a769-4362-b7e3-2f55ba89ec34 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:12.196724 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-95bf8ec7-a769-4362-b7e3-2f55ba89ec34 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:12.197211 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-95bf8ec7-a769-4362-b7e3-2f55ba89ec34 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:12.197626 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-95bf8ec7-a769-4362-b7e3-2f55ba89ec34 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:12.341932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-95bf8ec7-a769-4362-b7e3-2f55ba89ec34 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:12.350544 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-95bf8ec7-a769-4362-b7e3-2f55ba89ec34 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1756 microversion: 2.1 time: 0.166867 Sep 20 22:32:12.351280 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 470/917] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:12 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:13.375344 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-4972634e-305f-4836-8ba7-b5174c844df5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:13.376209 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-4972634e-305f-4836-8ba7-b5174c844df5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:13.383254 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4972634e-305f-4836-8ba7-b5174c844df5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:13.383845 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4972634e-305f-4836-8ba7-b5174c844df5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:13.384315 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4972634e-305f-4836-8ba7-b5174c844df5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:13.385058 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4972634e-305f-4836-8ba7-b5174c844df5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:13.385497 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4972634e-305f-4836-8ba7-b5174c844df5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:13.385920 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4972634e-305f-4836-8ba7-b5174c844df5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:13.528299 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-4972634e-305f-4836-8ba7-b5174c844df5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:13.536652 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-4972634e-305f-4836-8ba7-b5174c844df5 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1756 microversion: 2.1 time: 0.165647 Sep 20 22:32:13.537235 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 448/918] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:13 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:32:14.560288 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-cc7748cf-304f-4fea-9e1a-b9fbc648b19f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:14.567235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-cc7748cf-304f-4fea-9e1a-b9fbc648b19f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:14.568131 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cc7748cf-304f-4fea-9e1a-b9fbc648b19f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:14.568607 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cc7748cf-304f-4fea-9e1a-b9fbc648b19f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:14.569063 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cc7748cf-304f-4fea-9e1a-b9fbc648b19f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:14.569747 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cc7748cf-304f-4fea-9e1a-b9fbc648b19f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:14.570195 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cc7748cf-304f-4fea-9e1a-b9fbc648b19f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:14.570612 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-cc7748cf-304f-4fea-9e1a-b9fbc648b19f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:14.709744 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-cc7748cf-304f-4fea-9e1a-b9fbc648b19f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:14.717723 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-cc7748cf-304f-4fea-9e1a-b9fbc648b19f tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1756 microversion: 2.1 time: 0.161628 Sep 20 22:32:14.718278 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 471/919] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:14 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:32:15.740447 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-9e9da072-2de7-4553-b0da-69c5fb6ee361 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:15.741090 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-9e9da072-2de7-4553-b0da-69c5fb6ee361 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:15.748003 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9e9da072-2de7-4553-b0da-69c5fb6ee361 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:15.748546 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9e9da072-2de7-4553-b0da-69c5fb6ee361 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:15.749024 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9e9da072-2de7-4553-b0da-69c5fb6ee361 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:15.749722 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9e9da072-2de7-4553-b0da-69c5fb6ee361 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:15.750174 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9e9da072-2de7-4553-b0da-69c5fb6ee361 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:15.750597 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9e9da072-2de7-4553-b0da-69c5fb6ee361 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:15.889704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-9e9da072-2de7-4553-b0da-69c5fb6ee361 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:15.897974 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-9e9da072-2de7-4553-b0da-69c5fb6ee361 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1756 microversion: 2.1 time: 0.161477 Sep 20 22:32:15.898537 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 449/920] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:15 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:16.922507 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-0c53b5db-69fb-4623-bbe5-cafa9c803e23 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:16.923120 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-0c53b5db-69fb-4623-bbe5-cafa9c803e23 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:16.929544 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0c53b5db-69fb-4623-bbe5-cafa9c803e23 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:16.930026 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0c53b5db-69fb-4623-bbe5-cafa9c803e23 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:16.930459 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0c53b5db-69fb-4623-bbe5-cafa9c803e23 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:16.931151 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0c53b5db-69fb-4623-bbe5-cafa9c803e23 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:16.931606 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0c53b5db-69fb-4623-bbe5-cafa9c803e23 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:16.932023 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-0c53b5db-69fb-4623-bbe5-cafa9c803e23 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:17.072387 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-0c53b5db-69fb-4623-bbe5-cafa9c803e23 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:17.080528 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-0c53b5db-69fb-4623-bbe5-cafa9c803e23 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1756 microversion: 2.1 time: 0.162527 Sep 20 22:32:17.081119 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 472/921] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:16 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:18.103942 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-10796121-e28d-41c9-b419-e0f475447fbd tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:18.104564 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-10796121-e28d-41c9-b419-e0f475447fbd tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:18.111508 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-10796121-e28d-41c9-b419-e0f475447fbd tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:18.111990 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-10796121-e28d-41c9-b419-e0f475447fbd tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:18.112433 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-10796121-e28d-41c9-b419-e0f475447fbd tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:18.113166 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-10796121-e28d-41c9-b419-e0f475447fbd tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:18.113623 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-10796121-e28d-41c9-b419-e0f475447fbd tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:18.114046 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-10796121-e28d-41c9-b419-e0f475447fbd tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:18.265336 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-10796121-e28d-41c9-b419-e0f475447fbd tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:18.273684 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-10796121-e28d-41c9-b419-e0f475447fbd tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1756 microversion: 2.1 time: 0.173975 Sep 20 22:32:18.274269 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 450/922] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:18 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:18.452936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-6094173a-e815-49b7-83b1-e92b90c3fd59 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:18.453499 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-6094173a-e815-49b7-83b1-e92b90c3fd59 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:18.459616 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6094173a-e815-49b7-83b1-e92b90c3fd59 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:18.460093 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6094173a-e815-49b7-83b1-e92b90c3fd59 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:18.460522 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6094173a-e815-49b7-83b1-e92b90c3fd59 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:18.461234 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6094173a-e815-49b7-83b1-e92b90c3fd59 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:18.461681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6094173a-e815-49b7-83b1-e92b90c3fd59 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:18.462099 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6094173a-e815-49b7-83b1-e92b90c3fd59 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:18.485658 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-6094173a-e815-49b7-83b1-e92b90c3fd59 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960/ips" status: 200 len: 150 microversion: 2.1 time: 0.036712 Sep 20 22:32:18.486203 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 473/923] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 20 22:32:18 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:32:19.298342 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8498b202-4054-438d-b2a0-6fe6c47afb7e tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:19.298954 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8498b202-4054-438d-b2a0-6fe6c47afb7e tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:19.305307 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8498b202-4054-438d-b2a0-6fe6c47afb7e tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:19.305785 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8498b202-4054-438d-b2a0-6fe6c47afb7e tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:19.306219 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8498b202-4054-438d-b2a0-6fe6c47afb7e tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:19.306900 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8498b202-4054-438d-b2a0-6fe6c47afb7e tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:19.307365 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8498b202-4054-438d-b2a0-6fe6c47afb7e tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:19.307785 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8498b202-4054-438d-b2a0-6fe6c47afb7e tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:19.451586 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-8498b202-4054-438d-b2a0-6fe6c47afb7e tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:19.460541 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-8498b202-4054-438d-b2a0-6fe6c47afb7e tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1756 microversion: 2.1 time: 0.166593 Sep 20 22:32:19.461134 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 451/924] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:19 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:19.849993 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a950e465-8e73-47fb-95bd-4c1947a3274a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "feed8368-3333-49ea-a8a8-eceb1d7cd5d2"}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:32:19.852400 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a950e465-8e73-47fb-95bd-4c1947a3274a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:19.858827 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a950e465-8e73-47fb-95bd-4c1947a3274a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:19.859301 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a950e465-8e73-47fb-95bd-4c1947a3274a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:19.859727 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a950e465-8e73-47fb-95bd-4c1947a3274a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:19.860399 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a950e465-8e73-47fb-95bd-4c1947a3274a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:19.860846 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a950e465-8e73-47fb-95bd-4c1947a3274a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:19.861293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a950e465-8e73-47fb-95bd-4c1947a3274a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:20.092390 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a950e465-8e73-47fb-95bd-4c1947a3274a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "POST /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245918 Sep 20 22:32:20.093024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 474/925] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 20 22:32:19 2022] POST /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:32:20.485286 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-3e81b212-4075-4125-b4d1-7609c7945a64 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:20.485906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-3e81b212-4075-4125-b4d1-7609c7945a64 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:20.491882 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3e81b212-4075-4125-b4d1-7609c7945a64 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:20.492363 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3e81b212-4075-4125-b4d1-7609c7945a64 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:20.492799 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3e81b212-4075-4125-b4d1-7609c7945a64 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:20.493520 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3e81b212-4075-4125-b4d1-7609c7945a64 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:20.494224 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3e81b212-4075-4125-b4d1-7609c7945a64 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:20.494647 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3e81b212-4075-4125-b4d1-7609c7945a64 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:20.649082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-3e81b212-4075-4125-b4d1-7609c7945a64 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:20.657999 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-3e81b212-4075-4125-b4d1-7609c7945a64 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1759 microversion: 2.1 time: 0.176970 Sep 20 22:32:20.658539 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 452/926] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:20 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1759 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:26.571096 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-8f7e27b4-67e5-4d43-b6bf-bd87d1ad6857 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Action: 'create', calling method: .version_select at 0x7f24f693e3a0>, body: {"keypair": {"name": "tempest-keypair-208006715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNEmIG9IG6l0+7s3PP966A7XWYB/44beJj86Mu8QGu3O5OoKWp5c0bkkTTWwtz1ndmNCKS+lpImlIpONftNw2ZIYJdNOrQiJeI/UbGaqa2DmFrj0CL6XZ5eo55SAunMBQ=="}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:32:26.587539 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-8f7e27b4-67e5-4d43-b6bf-bd87d1ad6857 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Getting quotas for project 59af02f2b4984c6190870041aa020d75. Resources: {'key_pairs'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:32:26.591376 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-8f7e27b4-67e5-4d43-b6bf-bd87d1ad6857 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Getting quotas for user 4af67f949fda43bf8967925f04491bd8 and project 59af02f2b4984c6190870041aa020d75. Resources: {'key_pairs'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:32:26.613410 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-8f7e27b4-67e5-4d43-b6bf-bd87d1ad6857 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046462 Sep 20 22:32:26.614002 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 475/927] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 20 22:32:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:32:26.962607 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-30f55e48-4952-4a0c-a2ed-39f66f50cc6d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:26.963226 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-30f55e48-4952-4a0c-a2ed-39f66f50cc6d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:26.970929 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30f55e48-4952-4a0c-a2ed-39f66f50cc6d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:26.971353 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30f55e48-4952-4a0c-a2ed-39f66f50cc6d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:26.971797 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30f55e48-4952-4a0c-a2ed-39f66f50cc6d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:26.972543 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30f55e48-4952-4a0c-a2ed-39f66f50cc6d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:26.973104 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30f55e48-4952-4a0c-a2ed-39f66f50cc6d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:26.973548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30f55e48-4952-4a0c-a2ed-39f66f50cc6d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:27.002350 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-30f55e48-4952-4a0c-a2ed-39f66f50cc6d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Going to try to terminate instance {{(pid=120473) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:32:27.083269 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-30f55e48-4952-4a0c-a2ed-39f66f50cc6d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 204 len: 0 microversion: 2.1 time: 0.124111 Sep 20 22:32:27.083886 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 453/928] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:32:26 2022] DELETE /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:32:27.093939 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b8beab7d-de47-4c38-8663-a3868fa8219a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:27.094811 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b8beab7d-de47-4c38-8663-a3868fa8219a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:27.101879 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8beab7d-de47-4c38-8663-a3868fa8219a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:27.102442 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8beab7d-de47-4c38-8663-a3868fa8219a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:27.103058 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8beab7d-de47-4c38-8663-a3868fa8219a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:27.103702 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8beab7d-de47-4c38-8663-a3868fa8219a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:27.104161 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8beab7d-de47-4c38-8663-a3868fa8219a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:27.104585 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b8beab7d-de47-4c38-8663-a3868fa8219a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:27.328234 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b8beab7d-de47-4c38-8663-a3868fa8219a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:27.336560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b8beab7d-de47-4c38-8663-a3868fa8219a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1578 microversion: 2.1 time: 0.248027 Sep 20 22:32:27.346002 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 476/929] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:27 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1578 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:27.957377 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-422d5ada-01c1-4cb6-b539-34543a94fca2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-909186118", "imageRef": "a1be001e-c2e4-44b7-b0d2-af96de3855c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fdd6da27-ff07-48de-8020-aad44ec6dade"}], "security_groups": [{"name": "tempest-securitygroup--1115094419"}], "key_name": "tempest-keypair-208006715", "user_data": "}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:32:28.056963 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.network.neutron [None req-422d5ada-01c1-4cb6-b539-34543a94fca2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] validate_networks() for [('fdd6da27-ff07-48de-8020-aad44ec6dade', None, None, None, None, None)] {{(pid=120473) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:32:28.359663 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ac43e9f5-432f-45fd-818d-2a818c0c64c9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:28.360277 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ac43e9f5-432f-45fd-818d-2a818c0c64c9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:28.366902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ac43e9f5-432f-45fd-818d-2a818c0c64c9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:28.367387 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ac43e9f5-432f-45fd-818d-2a818c0c64c9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:28.367822 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ac43e9f5-432f-45fd-818d-2a818c0c64c9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:28.368520 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ac43e9f5-432f-45fd-818d-2a818c0c64c9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:28.369733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ac43e9f5-432f-45fd-818d-2a818c0c64c9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:28.370160 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ac43e9f5-432f-45fd-818d-2a818c0c64c9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:28.425158 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-422d5ada-01c1-4cb6-b539-34543a94fca2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Flavor limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:32:28.425604 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-422d5ada-01c1-4cb6-b539-34543a94fca2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Image limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:32:28.426072 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-422d5ada-01c1-4cb6-b539-34543a94fca2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Flavor pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:32:28.426472 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-422d5ada-01c1-4cb6-b539-34543a94fca2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Image pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:32:28.426872 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-422d5ada-01c1-4cb6-b539-34543a94fca2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:32:28.435493 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-422d5ada-01c1-4cb6-b539-34543a94fca2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:28.435976 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-422d5ada-01c1-4cb6-b539-34543a94fca2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:28.436403 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-422d5ada-01c1-4cb6-b539-34543a94fca2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:28.437150 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-422d5ada-01c1-4cb6-b539-34543a94fca2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:28.437601 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-422d5ada-01c1-4cb6-b539-34543a94fca2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:28.438016 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-422d5ada-01c1-4cb6-b539-34543a94fca2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:28.454294 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-422d5ada-01c1-4cb6-b539-34543a94fca2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Getting quotas for project 59af02f2b4984c6190870041aa020d75. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:32:28.458240 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-422d5ada-01c1-4cb6-b539-34543a94fca2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Getting quotas for user 4af67f949fda43bf8967925f04491bd8 and project 59af02f2b4984c6190870041aa020d75. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:32:28.469776 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-422d5ada-01c1-4cb6-b539-34543a94fca2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Going to run 1 instances... {{(pid=120473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:32:28.472176 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-422d5ada-01c1-4cb6-b539-34543a94fca2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a1be001e-c2e4-44b7-b0d2-af96de3855c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:32:28.505179 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ac43e9f5-432f-45fd-818d-2a818c0c64c9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:28.513141 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ac43e9f5-432f-45fd-818d-2a818c0c64c9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1578 microversion: 2.1 time: 0.158061 Sep 20 22:32:28.514446 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 477/930] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:28 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:32:28.520731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-422d5ada-01c1-4cb6-b539-34543a94fca2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.568180 Sep 20 22:32:28.521398 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 454/931] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:32:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 22:32:28.538929 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-6c228173-fa1b-46c7-a64c-9eca4f6b98db tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:28.539580 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-6c228173-fa1b-46c7-a64c-9eca4f6b98db tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:28.604817 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6c228173-fa1b-46c7-a64c-9eca4f6b98db tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:28.612239 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-6c228173-fa1b-46c7-a64c-9eca4f6b98db tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652" status: 200 len: 1240 microversion: 2.1 time: 0.078183 Sep 20 22:32:28.612993 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 478/932] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:28 2022] GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:32:29.541406 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-54af72ac-d8a4-451b-a157-91067693c57d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:29.542783 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-54af72ac-d8a4-451b-a157-91067693c57d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:29.550318 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54af72ac-d8a4-451b-a157-91067693c57d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:29.551340 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54af72ac-d8a4-451b-a157-91067693c57d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:29.552122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54af72ac-d8a4-451b-a157-91067693c57d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:29.553431 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54af72ac-d8a4-451b-a157-91067693c57d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:29.554217 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54af72ac-d8a4-451b-a157-91067693c57d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:29.554742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54af72ac-d8a4-451b-a157-91067693c57d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:29.620586 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-54af72ac-d8a4-451b-a157-91067693c57d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:29.628524 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-54af72ac-d8a4-451b-a157-91067693c57d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1510 microversion: 2.1 time: 0.096032 Sep 20 22:32:29.630337 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 455/933] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:29 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1510 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:29.638189 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-338c0357-b407-4137-8360-c5022a1d63bf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:29.639331 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-338c0357-b407-4137-8360-c5022a1d63bf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:29.645895 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-338c0357-b407-4137-8360-c5022a1d63bf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:29.646625 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-338c0357-b407-4137-8360-c5022a1d63bf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:29.647224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-338c0357-b407-4137-8360-c5022a1d63bf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:29.648770 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-338c0357-b407-4137-8360-c5022a1d63bf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:29.649354 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-338c0357-b407-4137-8360-c5022a1d63bf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:29.649694 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-338c0357-b407-4137-8360-c5022a1d63bf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:29.708632 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-61e6e471-176f-40c5-93bb-e8c833b965cf req-ef6fc850-ffac-4d74-9f00-f8cd9a91825f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1", "name": "network-vif-deleted", "tag": "44f0fe4e-7638-4e2e-98e3-eff3ce9acfe4"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:32:29.719268 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-61e6e471-176f-40c5-93bb-e8c833b965cf req-ef6fc850-ffac-4d74-9f00-f8cd9a91825f service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:29.719908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-61e6e471-176f-40c5-93bb-e8c833b965cf req-ef6fc850-ffac-4d74-9f00-f8cd9a91825f service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:29.720444 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-61e6e471-176f-40c5-93bb-e8c833b965cf req-ef6fc850-ffac-4d74-9f00-f8cd9a91825f service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:29.734352 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-61e6e471-176f-40c5-93bb-e8c833b965cf req-ef6fc850-ffac-4d74-9f00-f8cd9a91825f service nova] Creating event network-vif-deleted:44f0fe4e-7638-4e2e-98e3-eff3ce9acfe4 for instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 on hv-cinder-85827 Sep 20 22:32:29.734565 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-338c0357-b407-4137-8360-c5022a1d63bf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:29.740005 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-61e6e471-176f-40c5-93bb-e8c833b965cf req-ef6fc850-ffac-4d74-9f00-f8cd9a91825f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035625 Sep 20 22:32:29.743159 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-338c0357-b407-4137-8360-c5022a1d63bf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652" status: 200 len: 1292 microversion: 2.1 time: 0.108499 Sep 20 22:32:29.744238 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 479/934] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:29 2022] GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 => generated 1292 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:29.744359 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 456/935] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:32:30.661584 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-1fd35973-04aa-49b7-bef0-fd4cb52c2994 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:30.664065 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-1fd35973-04aa-49b7-bef0-fd4cb52c2994 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:30.674136 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1fd35973-04aa-49b7-bef0-fd4cb52c2994 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:30.674869 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1fd35973-04aa-49b7-bef0-fd4cb52c2994 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:30.675548 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1fd35973-04aa-49b7-bef0-fd4cb52c2994 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:30.676419 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1fd35973-04aa-49b7-bef0-fd4cb52c2994 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:30.677117 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1fd35973-04aa-49b7-bef0-fd4cb52c2994 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:30.677695 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1fd35973-04aa-49b7-bef0-fd4cb52c2994 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:30.742201 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1fd35973-04aa-49b7-bef0-fd4cb52c2994 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:30.742982 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1fd35973-04aa-49b7-bef0-fd4cb52c2994 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:30.743600 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1fd35973-04aa-49b7-bef0-fd4cb52c2994 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:30.744479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-1fd35973-04aa-49b7-bef0-fd4cb52c2994 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lazy-loading 'fault' on Instance uuid 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:32:30.769281 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-27a799d5-233e-4f3d-8c4f-6ac4d6603fc5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:30.770076 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-27a799d5-233e-4f3d-8c4f-6ac4d6603fc5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:30.781088 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-27a799d5-233e-4f3d-8c4f-6ac4d6603fc5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:30.781594 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-27a799d5-233e-4f3d-8c4f-6ac4d6603fc5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:30.782036 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-27a799d5-233e-4f3d-8c4f-6ac4d6603fc5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:30.782761 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-27a799d5-233e-4f3d-8c4f-6ac4d6603fc5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:30.783217 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-27a799d5-233e-4f3d-8c4f-6ac4d6603fc5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:30.783828 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-27a799d5-233e-4f3d-8c4f-6ac4d6603fc5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:30.811580 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-1fd35973-04aa-49b7-bef0-fd4cb52c2994 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:30.822747 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-1fd35973-04aa-49b7-bef0-fd4cb52c2994 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 200 len: 1183 microversion: 2.1 time: 0.173640 Sep 20 22:32:30.824573 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 480/936] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:30 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 1183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:30.952648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-27a799d5-233e-4f3d-8c4f-6ac4d6603fc5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:30.962370 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-27a799d5-233e-4f3d-8c4f-6ac4d6603fc5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652" status: 200 len: 1366 microversion: 2.1 time: 0.199104 Sep 20 22:32:30.962961 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 457/937] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:30 2022] GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:31.756141 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-21fb339b-99f6-42b9-93ee-7a87bf996bc5 req-20b92bc2-1feb-4d48-ba10-881c2055f81f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8c1229b-9470-4d8f-8451-6fc1e718b652", "tag": "093b362f-098e-4d4d-84e5-a8dcd1760122"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:32:31.766550 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-21fb339b-99f6-42b9-93ee-7a87bf996bc5 req-20b92bc2-1feb-4d48-ba10-881c2055f81f service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:31.767027 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-21fb339b-99f6-42b9-93ee-7a87bf996bc5 req-20b92bc2-1feb-4d48-ba10-881c2055f81f service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:31.767462 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-21fb339b-99f6-42b9-93ee-7a87bf996bc5 req-20b92bc2-1feb-4d48-ba10-881c2055f81f service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:31.778051 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-21fb339b-99f6-42b9-93ee-7a87bf996bc5 req-20b92bc2-1feb-4d48-ba10-881c2055f81f service nova] Creating event network-changed:093b362f-098e-4d4d-84e5-a8dcd1760122 for instance f8c1229b-9470-4d8f-8451-6fc1e718b652 on hv-cinder-85827 Sep 20 22:32:31.783554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-21fb339b-99f6-42b9-93ee-7a87bf996bc5 req-20b92bc2-1feb-4d48-ba10-881c2055f81f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031126 Sep 20 22:32:31.784377 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 481/938] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:32:31.847580 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6a655d80-df7b-4261-b5e9-081f055533e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:31.848663 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-6a655d80-df7b-4261-b5e9-081f055533e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:31.856046 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6a655d80-df7b-4261-b5e9-081f055533e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:31.856534 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6a655d80-df7b-4261-b5e9-081f055533e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:31.856994 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6a655d80-df7b-4261-b5e9-081f055533e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:31.857727 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6a655d80-df7b-4261-b5e9-081f055533e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:31.858390 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6a655d80-df7b-4261-b5e9-081f055533e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:31.858907 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6a655d80-df7b-4261-b5e9-081f055533e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:31.863079 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:31.875094 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-6a655d80-df7b-4261-b5e9-081f055533e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] HTTP exception thrown: Instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 could not be found. Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6a655d80-df7b-4261-b5e9-081f055533e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Request method failure captured: Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 HTTP/1.1 Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj7DhnCl26lGwWR9DBtjb-oo553Ik-4pWp8N4Xmdq2pT6zAlEsSu1msv05dIUnCV2oYTR9ZkcsnL736mrZ6I_zJ2ZklLiY4p_TfysEaCHqitrYy4DSZ2WRkO_ehACFl_0mlrNJ5KC8kQQ2p9RHKVWvIlPUeNqTsdh0WyeBVYhlxoIv4 Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: 42019663de764ee490940ccca9300b0f Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-TestVolumeBootPattern-1539651322 Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:32:31.876780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:32:31.878578 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42019663de764ee490940ccca9300b0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42019663de764ee490940ccca9300b0f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42019663de764ee490940ccca9300b0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42019663de764ee490940ccca9300b0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:32:31.878578 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-TestVolumeBootPattern-1539651322 Sep 20 22:32:31.878578 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: 42019663de764ee490940ccca9300b0f Sep 20 22:32:31.878578 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-TestVolumeBootPattern-1539651322 Sep 20 22:32:31.878578 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-TestVolumeBootPattern-1539651322-project Sep 20 22:32:31.878578 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:32:31.878578 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:32:31.878578 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: b1b69806fd5f4885a824a58fa1d4432c Sep 20 22:32:31.878578 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-TestVolumeBootPattern-1539651322-project Sep 20 22:32:31.878578 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:32:31.878578 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 could not be found. Sep 20 22:32:31.878578 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': '9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1'} Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 could not be found. Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:32:31.879491 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:32:31.880843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:32:31.880843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:32:31.880843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:32:31.880843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:32:31.880843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:32:31.880843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:32:31.880843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:32:31.880843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 could not be found. Sep 20 22:32:31.880843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:32:31.880843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:32:31.880843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:32:31.880843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:32:31.880843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:32:31.880843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:32:31.880843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:32:31.880843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:32:31.880843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 could not be found. Sep 20 22:32:31.880843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:32:31.882837 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6a655d80-df7b-4261-b5e9-081f055533e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Returning 404 to user: Instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:32:31.882837 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-6a655d80-df7b-4261-b5e9-081f055533e3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 404 len: 111 microversion: 2.1 time: 0.034977 Sep 20 22:32:31.882837 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 458/939] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:31 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 20 22:32:31.987134 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-8c5891d7-a29b-46a3-858b-8cfc88c9d5e3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:31.987861 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-8c5891d7-a29b-46a3-858b-8cfc88c9d5e3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:31.993980 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6e97bbe2-d65e-4dd1-99fb-315657223079 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2078341964", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-262726890", "security_groups": [{"name": "tempest-secgroup-smoke-2073120544"}], "block_device_mapping_v2": [{"uuid": "94de95c3-9489-4551-93f1-1daab600e698", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "da8aba85-9a54-4a6e-abea-b06fe770c5b2"}]}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:32:31.994541 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8c5891d7-a29b-46a3-858b-8cfc88c9d5e3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:31.995476 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8c5891d7-a29b-46a3-858b-8cfc88c9d5e3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:31.995630 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8c5891d7-a29b-46a3-858b-8cfc88c9d5e3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:31.996188 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8c5891d7-a29b-46a3-858b-8cfc88c9d5e3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:31.996639 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8c5891d7-a29b-46a3-858b-8cfc88c9d5e3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:31.997081 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8c5891d7-a29b-46a3-858b-8cfc88c9d5e3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:32.115040 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.network.neutron [None req-6e97bbe2-d65e-4dd1-99fb-315657223079 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] validate_networks() for [('da8aba85-9a54-4a6e-abea-b06fe770c5b2', None, None, None, None, None)] {{(pid=120473) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:32:32.142462 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-8c5891d7-a29b-46a3-858b-8cfc88c9d5e3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:32.150083 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-8c5891d7-a29b-46a3-858b-8cfc88c9d5e3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652" status: 200 len: 1366 microversion: 2.1 time: 0.167536 Sep 20 22:32:32.150659 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 482/940] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:31 2022] GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:32.485781 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-6e97bbe2-d65e-4dd1-99fb-315657223079 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Flavor limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:32:32.486208 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-6e97bbe2-d65e-4dd1-99fb-315657223079 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Image limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:32:32.486683 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-6e97bbe2-d65e-4dd1-99fb-315657223079 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Flavor pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:32:32.487088 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-6e97bbe2-d65e-4dd1-99fb-315657223079 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Image pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:32:32.487494 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-6e97bbe2-d65e-4dd1-99fb-315657223079 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:32:32.496389 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6e97bbe2-d65e-4dd1-99fb-315657223079 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:32.496871 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6e97bbe2-d65e-4dd1-99fb-315657223079 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:32.497331 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6e97bbe2-d65e-4dd1-99fb-315657223079 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:32.498696 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6e97bbe2-d65e-4dd1-99fb-315657223079 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:32.499165 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6e97bbe2-d65e-4dd1-99fb-315657223079 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:32.499595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6e97bbe2-d65e-4dd1-99fb-315657223079 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:32.515970 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-6e97bbe2-d65e-4dd1-99fb-315657223079 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Getting quotas for project 42019663de764ee490940ccca9300b0f. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:32:32.519863 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-6e97bbe2-d65e-4dd1-99fb-315657223079 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Getting quotas for user b1b69806fd5f4885a824a58fa1d4432c and project 42019663de764ee490940ccca9300b0f. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:32:32.583993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-6e97bbe2-d65e-4dd1-99fb-315657223079 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Going to run 1 instances... {{(pid=120473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:32:32.586197 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-6e97bbe2-d65e-4dd1-99fb-315657223079 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='94de95c3-9489-4551-93f1-1daab600e698',volume_size=None,volume_type=None)] {{(pid=120473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:32:32.678517 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:32.720685 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-6e97bbe2-d65e-4dd1-99fb-315657223079 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.731210 Sep 20 22:32:32.721725 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 459/941] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:32:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 20 22:32:32.733169 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3a5bc9a6-ca42-41de-a213-a067386a4407 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:32.733936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-3a5bc9a6-ca42-41de-a213-a067386a4407 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:32.735991 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:32.832128 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3a5bc9a6-ca42-41de-a213-a067386a4407 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:32.839282 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-3a5bc9a6-ca42-41de-a213-a067386a4407 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1094 microversion: 2.1 time: 0.110742 Sep 20 22:32:32.840184 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 483/942] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:32 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1094 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:33.179188 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-41923784-84bf-4018-b306-7cffed4b077a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:33.179805 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-41923784-84bf-4018-b306-7cffed4b077a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:33.185932 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-41923784-84bf-4018-b306-7cffed4b077a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:33.186416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-41923784-84bf-4018-b306-7cffed4b077a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:33.187482 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-41923784-84bf-4018-b306-7cffed4b077a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:33.188184 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-41923784-84bf-4018-b306-7cffed4b077a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:33.188801 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-41923784-84bf-4018-b306-7cffed4b077a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:33.189253 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-41923784-84bf-4018-b306-7cffed4b077a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:33.336730 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-41923784-84bf-4018-b306-7cffed4b077a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:33.346372 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-41923784-84bf-4018-b306-7cffed4b077a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652" status: 200 len: 1366 microversion: 2.1 time: 0.172671 Sep 20 22:32:33.346941 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 460/943] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:33 2022] GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:33.862694 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9bf59763-d2d7-4aca-9624-7a34121ec45a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:33.863999 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9bf59763-d2d7-4aca-9624-7a34121ec45a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:33.874905 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9bf59763-d2d7-4aca-9624-7a34121ec45a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:33.876517 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9bf59763-d2d7-4aca-9624-7a34121ec45a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:33.877055 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9bf59763-d2d7-4aca-9624-7a34121ec45a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:33.877869 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9bf59763-d2d7-4aca-9624-7a34121ec45a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:33.878474 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9bf59763-d2d7-4aca-9624-7a34121ec45a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:33.878970 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9bf59763-d2d7-4aca-9624-7a34121ec45a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:33.883634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:33.962371 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-9bf59763-d2d7-4aca-9624-7a34121ec45a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:33.971815 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-9bf59763-d2d7-4aca-9624-7a34121ec45a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1200 microversion: 2.1 time: 0.113753 Sep 20 22:32:33.972532 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 484/944] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:33 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1200 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:34.370309 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-256b11e1-415e-4e67-8063-c7df9f70d51f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:34.371540 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-256b11e1-415e-4e67-8063-c7df9f70d51f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:34.381645 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-256b11e1-415e-4e67-8063-c7df9f70d51f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:34.382326 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-256b11e1-415e-4e67-8063-c7df9f70d51f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:34.383016 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-256b11e1-415e-4e67-8063-c7df9f70d51f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:34.384181 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-256b11e1-415e-4e67-8063-c7df9f70d51f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:34.384874 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-256b11e1-415e-4e67-8063-c7df9f70d51f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:34.385587 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-256b11e1-415e-4e67-8063-c7df9f70d51f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:34.534813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-256b11e1-415e-4e67-8063-c7df9f70d51f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:34.542931 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-256b11e1-415e-4e67-8063-c7df9f70d51f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652" status: 200 len: 1366 microversion: 2.1 time: 0.176971 Sep 20 22:32:34.543509 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 461/945] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:34 2022] GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:35.000048 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-d3e04740-9a21-4745-af89-201e4d02d5ee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:35.000598 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-d3e04740-9a21-4745-af89-201e4d02d5ee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:35.007008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d3e04740-9a21-4745-af89-201e4d02d5ee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:35.007488 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d3e04740-9a21-4745-af89-201e4d02d5ee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:35.007915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d3e04740-9a21-4745-af89-201e4d02d5ee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:35.008791 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d3e04740-9a21-4745-af89-201e4d02d5ee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:35.009265 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d3e04740-9a21-4745-af89-201e4d02d5ee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:35.009688 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d3e04740-9a21-4745-af89-201e4d02d5ee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:35.248470 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-d3e04740-9a21-4745-af89-201e4d02d5ee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:35.256396 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-d3e04740-9a21-4745-af89-201e4d02d5ee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1266 microversion: 2.1 time: 0.260323 Sep 20 22:32:35.256989 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 485/946] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:34 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:35.407421 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-aa026103-2413-4723-b860-62f5916d432e req-126e14e8-ec4e-43a9-bdd3-424dd7cc58f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0da41d34-e3ba-4805-8662-2461d3b48ec0", "tag": "a06a3906-0bdb-4e5e-a8ce-e043710e1f6b"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:32:35.422502 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-aa026103-2413-4723-b860-62f5916d432e req-126e14e8-ec4e-43a9-bdd3-424dd7cc58f2 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:35.423256 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-aa026103-2413-4723-b860-62f5916d432e req-126e14e8-ec4e-43a9-bdd3-424dd7cc58f2 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:35.423895 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-aa026103-2413-4723-b860-62f5916d432e req-126e14e8-ec4e-43a9-bdd3-424dd7cc58f2 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:35.448103 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-aa026103-2413-4723-b860-62f5916d432e req-126e14e8-ec4e-43a9-bdd3-424dd7cc58f2 service nova] Creating event network-changed:a06a3906-0bdb-4e5e-a8ce-e043710e1f6b for instance 0da41d34-e3ba-4805-8662-2461d3b48ec0 on hv-cinder-85827 Sep 20 22:32:35.455413 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-aa026103-2413-4723-b860-62f5916d432e req-126e14e8-ec4e-43a9-bdd3-424dd7cc58f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052389 Sep 20 22:32:35.456037 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 462/947] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:32:35.566507 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ae214508-bb18-4d74-ae2c-da6e6634ccab tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:35.567122 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ae214508-bb18-4d74-ae2c-da6e6634ccab tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:35.573197 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ae214508-bb18-4d74-ae2c-da6e6634ccab tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:35.573691 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ae214508-bb18-4d74-ae2c-da6e6634ccab tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:35.574125 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ae214508-bb18-4d74-ae2c-da6e6634ccab tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:35.574822 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ae214508-bb18-4d74-ae2c-da6e6634ccab tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:35.575276 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ae214508-bb18-4d74-ae2c-da6e6634ccab tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:35.575709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ae214508-bb18-4d74-ae2c-da6e6634ccab tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:36.043548 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ae214508-bb18-4d74-ae2c-da6e6634ccab tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:36.051834 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ae214508-bb18-4d74-ae2c-da6e6634ccab tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652" status: 200 len: 1366 microversion: 2.1 time: 0.489232 Sep 20 22:32:36.052496 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 486/948] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:35 2022] GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 => generated 1366 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:36.280476 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ba2c23f7-90cf-49ca-8610-e044b762fda9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:36.281224 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ba2c23f7-90cf-49ca-8610-e044b762fda9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:36.287348 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ba2c23f7-90cf-49ca-8610-e044b762fda9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:36.287827 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ba2c23f7-90cf-49ca-8610-e044b762fda9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:36.288257 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ba2c23f7-90cf-49ca-8610-e044b762fda9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:36.288939 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ba2c23f7-90cf-49ca-8610-e044b762fda9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:36.289412 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ba2c23f7-90cf-49ca-8610-e044b762fda9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:36.289830 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ba2c23f7-90cf-49ca-8610-e044b762fda9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:36.421698 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-ba2c23f7-90cf-49ca-8610-e044b762fda9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:36.430604 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ba2c23f7-90cf-49ca-8610-e044b762fda9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1266 microversion: 2.1 time: 0.154298 Sep 20 22:32:36.431455 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 463/949] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:36 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:37.076253 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-7c65459b-dbed-4b54-8f78-dd5b3480a03d tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:37.076803 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-7c65459b-dbed-4b54-8f78-dd5b3480a03d tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:37.084408 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7c65459b-dbed-4b54-8f78-dd5b3480a03d tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:37.084922 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7c65459b-dbed-4b54-8f78-dd5b3480a03d tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:37.085396 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7c65459b-dbed-4b54-8f78-dd5b3480a03d tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:37.086096 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7c65459b-dbed-4b54-8f78-dd5b3480a03d tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:37.086584 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7c65459b-dbed-4b54-8f78-dd5b3480a03d tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:37.087007 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7c65459b-dbed-4b54-8f78-dd5b3480a03d tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:37.223108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-7c65459b-dbed-4b54-8f78-dd5b3480a03d tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:37.231251 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-7c65459b-dbed-4b54-8f78-dd5b3480a03d tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652" status: 200 len: 1366 microversion: 2.1 time: 0.159944 Sep 20 22:32:37.231828 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 487/950] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:37 2022] GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:37.308417 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-ea78e6aa-d1cc-4e1b-96d2-d37e55b841fd req-4a6429da-2a3a-4ae6-9759-39a12631e524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8c1229b-9470-4d8f-8451-6fc1e718b652", "name": "network-vif-plugged", "status": "completed", "tag": "093b362f-098e-4d4d-84e5-a8dcd1760122"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:32:37.318811 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-ea78e6aa-d1cc-4e1b-96d2-d37e55b841fd req-4a6429da-2a3a-4ae6-9759-39a12631e524 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:37.319331 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-ea78e6aa-d1cc-4e1b-96d2-d37e55b841fd req-4a6429da-2a3a-4ae6-9759-39a12631e524 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:37.319781 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-ea78e6aa-d1cc-4e1b-96d2-d37e55b841fd req-4a6429da-2a3a-4ae6-9759-39a12631e524 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:37.331813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-ea78e6aa-d1cc-4e1b-96d2-d37e55b841fd req-4a6429da-2a3a-4ae6-9759-39a12631e524 service nova] Creating event network-vif-plugged:093b362f-098e-4d4d-84e5-a8dcd1760122 for instance f8c1229b-9470-4d8f-8451-6fc1e718b652 on hv-cinder-85827 Sep 20 22:32:37.336445 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-ea78e6aa-d1cc-4e1b-96d2-d37e55b841fd req-4a6429da-2a3a-4ae6-9759-39a12631e524 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031894 Sep 20 22:32:37.337065 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 464/951] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:32:37.455611 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-6238fcaf-7183-482a-abf9-233cfcf2e7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:37.456279 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-6238fcaf-7183-482a-abf9-233cfcf2e7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:37.462403 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6238fcaf-7183-482a-abf9-233cfcf2e7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:37.462891 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6238fcaf-7183-482a-abf9-233cfcf2e7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:37.463334 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6238fcaf-7183-482a-abf9-233cfcf2e7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:37.464024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6238fcaf-7183-482a-abf9-233cfcf2e7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:37.464560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6238fcaf-7183-482a-abf9-233cfcf2e7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:37.465016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6238fcaf-7183-482a-abf9-233cfcf2e7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:37.631887 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-6238fcaf-7183-482a-abf9-233cfcf2e7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:37.639459 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-6238fcaf-7183-482a-abf9-233cfcf2e7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1266 microversion: 2.1 time: 0.188532 Sep 20 22:32:37.640021 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 488/952] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:37 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:38.256137 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-3ddbd6f1-dbe9-4c32-a95f-2be1ded9604f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:38.256843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-3ddbd6f1-dbe9-4c32-a95f-2be1ded9604f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:38.263740 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3ddbd6f1-dbe9-4c32-a95f-2be1ded9604f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:38.264223 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3ddbd6f1-dbe9-4c32-a95f-2be1ded9604f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:38.264658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3ddbd6f1-dbe9-4c32-a95f-2be1ded9604f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:38.265384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3ddbd6f1-dbe9-4c32-a95f-2be1ded9604f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:38.265838 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3ddbd6f1-dbe9-4c32-a95f-2be1ded9604f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:38.266263 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3ddbd6f1-dbe9-4c32-a95f-2be1ded9604f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:38.394450 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-3ddbd6f1-dbe9-4c32-a95f-2be1ded9604f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:38.402034 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-3ddbd6f1-dbe9-4c32-a95f-2be1ded9604f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652" status: 200 len: 1366 microversion: 2.1 time: 0.150772 Sep 20 22:32:38.402601 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 465/953] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:38 2022] GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:38.661925 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ed737d1d-493e-469d-9c42-ebd6b9732eb6 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:38.662532 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ed737d1d-493e-469d-9c42-ebd6b9732eb6 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:38.668951 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ed737d1d-493e-469d-9c42-ebd6b9732eb6 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:38.669451 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ed737d1d-493e-469d-9c42-ebd6b9732eb6 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:38.669909 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ed737d1d-493e-469d-9c42-ebd6b9732eb6 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:38.670610 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ed737d1d-493e-469d-9c42-ebd6b9732eb6 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:38.671032 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ed737d1d-493e-469d-9c42-ebd6b9732eb6 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:38.671503 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ed737d1d-493e-469d-9c42-ebd6b9732eb6 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:38.797516 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ed737d1d-493e-469d-9c42-ebd6b9732eb6 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:38.805152 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ed737d1d-493e-469d-9c42-ebd6b9732eb6 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1266 microversion: 2.1 time: 0.147256 Sep 20 22:32:38.805715 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 489/954] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:38 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:39.426182 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-67d63483-e80e-48f5-ac6b-fad0543e0015 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:39.426828 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-67d63483-e80e-48f5-ac6b-fad0543e0015 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:39.433250 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-67d63483-e80e-48f5-ac6b-fad0543e0015 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:39.433730 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-67d63483-e80e-48f5-ac6b-fad0543e0015 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:39.434159 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-67d63483-e80e-48f5-ac6b-fad0543e0015 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:39.434873 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-67d63483-e80e-48f5-ac6b-fad0543e0015 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:39.435325 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-67d63483-e80e-48f5-ac6b-fad0543e0015 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:39.435744 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-67d63483-e80e-48f5-ac6b-fad0543e0015 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:39.562280 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-67d63483-e80e-48f5-ac6b-fad0543e0015 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:39.569822 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-67d63483-e80e-48f5-ac6b-fad0543e0015 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652" status: 200 len: 1556 microversion: 2.1 time: 0.147505 Sep 20 22:32:39.570378 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 466/955] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:39 2022] GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 => generated 1556 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:39.592130 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-eba40baa-bd36-4c8d-8999-7f1f3e818f04 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:39.592646 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-eba40baa-bd36-4c8d-8999-7f1f3e818f04 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:39.598779 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eba40baa-bd36-4c8d-8999-7f1f3e818f04 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:39.599330 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eba40baa-bd36-4c8d-8999-7f1f3e818f04 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:39.599786 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eba40baa-bd36-4c8d-8999-7f1f3e818f04 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:39.600688 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eba40baa-bd36-4c8d-8999-7f1f3e818f04 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:39.601194 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eba40baa-bd36-4c8d-8999-7f1f3e818f04 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:39.601673 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-eba40baa-bd36-4c8d-8999-7f1f3e818f04 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:39.677878 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-eba40baa-bd36-4c8d-8999-7f1f3e818f04 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090050 Sep 20 22:32:39.678587 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 490/956] 10.222.0.16 () {58 vars in 1275 bytes} [Tue Sep 20 22:32:39 2022] GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:32:39.828657 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-7046cea4-71b5-4fb9-a55a-d0d0e2244085 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:39.829224 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-7046cea4-71b5-4fb9-a55a-d0d0e2244085 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:39.835180 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7046cea4-71b5-4fb9-a55a-d0d0e2244085 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:39.835671 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7046cea4-71b5-4fb9-a55a-d0d0e2244085 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:39.836128 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7046cea4-71b5-4fb9-a55a-d0d0e2244085 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:39.836822 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7046cea4-71b5-4fb9-a55a-d0d0e2244085 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:39.837300 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7046cea4-71b5-4fb9-a55a-d0d0e2244085 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:39.837719 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7046cea4-71b5-4fb9-a55a-d0d0e2244085 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:39.969891 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-7046cea4-71b5-4fb9-a55a-d0d0e2244085 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:39.977458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-7046cea4-71b5-4fb9-a55a-d0d0e2244085 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1266 microversion: 2.1 time: 0.153510 Sep 20 22:32:39.978027 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 467/957] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:39 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:40.588552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-17ecfd1a-11ad-4985-a8f4-b548dfc629fe req-9e79ca4e-1370-45b0-9a0f-238802873adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8c1229b-9470-4d8f-8451-6fc1e718b652", "tag": "093b362f-098e-4d4d-84e5-a8dcd1760122"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:32:40.598552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-17ecfd1a-11ad-4985-a8f4-b548dfc629fe req-9e79ca4e-1370-45b0-9a0f-238802873adc service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:40.599028 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-17ecfd1a-11ad-4985-a8f4-b548dfc629fe req-9e79ca4e-1370-45b0-9a0f-238802873adc service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:40.599646 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-17ecfd1a-11ad-4985-a8f4-b548dfc629fe req-9e79ca4e-1370-45b0-9a0f-238802873adc service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:40.610729 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-17ecfd1a-11ad-4985-a8f4-b548dfc629fe req-9e79ca4e-1370-45b0-9a0f-238802873adc service nova] Creating event network-changed:093b362f-098e-4d4d-84e5-a8dcd1760122 for instance f8c1229b-9470-4d8f-8451-6fc1e718b652 on hv-cinder-85827 Sep 20 22:32:40.615749 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-17ecfd1a-11ad-4985-a8f4-b548dfc629fe req-9e79ca4e-1370-45b0-9a0f-238802873adc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030887 Sep 20 22:32:40.616546 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 491/958] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:32:41.001670 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-03b439fe-ba9e-423b-ac60-757fa64267c5 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:41.002535 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-03b439fe-ba9e-423b-ac60-757fa64267c5 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:41.009309 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-03b439fe-ba9e-423b-ac60-757fa64267c5 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:41.009849 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-03b439fe-ba9e-423b-ac60-757fa64267c5 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:41.010388 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-03b439fe-ba9e-423b-ac60-757fa64267c5 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:41.011194 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-03b439fe-ba9e-423b-ac60-757fa64267c5 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:41.011881 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-03b439fe-ba9e-423b-ac60-757fa64267c5 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:41.012446 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-03b439fe-ba9e-423b-ac60-757fa64267c5 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:41.153742 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-03b439fe-ba9e-423b-ac60-757fa64267c5 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:41.161551 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-03b439fe-ba9e-423b-ac60-757fa64267c5 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1266 microversion: 2.1 time: 0.164416 Sep 20 22:32:41.162121 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 468/959] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:40 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:42.187833 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4fd696d4-60d7-4313-a8d0-995b215cc7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:42.187833 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4fd696d4-60d7-4313-a8d0-995b215cc7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:42.194489 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4fd696d4-60d7-4313-a8d0-995b215cc7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:42.194988 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4fd696d4-60d7-4313-a8d0-995b215cc7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:42.195424 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4fd696d4-60d7-4313-a8d0-995b215cc7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:42.196120 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4fd696d4-60d7-4313-a8d0-995b215cc7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:42.196580 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4fd696d4-60d7-4313-a8d0-995b215cc7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:42.197031 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4fd696d4-60d7-4313-a8d0-995b215cc7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:42.331812 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4fd696d4-60d7-4313-a8d0-995b215cc7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:42.339454 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4fd696d4-60d7-4313-a8d0-995b215cc7da tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1266 microversion: 2.1 time: 0.159413 Sep 20 22:32:42.340025 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 492/960] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:42 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:43.362944 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-23f2ff3c-370d-41e4-9e4c-3c59c2580ec2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:43.363478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-23f2ff3c-370d-41e4-9e4c-3c59c2580ec2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:43.365966 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=4 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:43.366757 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=12 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:43.372883 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-23f2ff3c-370d-41e4-9e4c-3c59c2580ec2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:43.373403 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-23f2ff3c-370d-41e4-9e4c-3c59c2580ec2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:43.373863 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-23f2ff3c-370d-41e4-9e4c-3c59c2580ec2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:43.374539 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-23f2ff3c-370d-41e4-9e4c-3c59c2580ec2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:43.374993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-23f2ff3c-370d-41e4-9e4c-3c59c2580ec2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:43.375416 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-23f2ff3c-370d-41e4-9e4c-3c59c2580ec2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:43.503447 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-23f2ff3c-370d-41e4-9e4c-3c59c2580ec2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:43.511124 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-23f2ff3c-370d-41e4-9e4c-3c59c2580ec2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1266 microversion: 2.1 time: 0.152141 Sep 20 22:32:43.511687 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 469/961] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:43 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:44.534425 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-2c78442a-2ff4-4682-a013-73d4710d7094 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:44.534950 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-2c78442a-2ff4-4682-a013-73d4710d7094 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:44.536872 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=8 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:44.542416 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2c78442a-2ff4-4682-a013-73d4710d7094 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:44.542896 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2c78442a-2ff4-4682-a013-73d4710d7094 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:44.543330 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2c78442a-2ff4-4682-a013-73d4710d7094 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:44.544024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2c78442a-2ff4-4682-a013-73d4710d7094 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:44.544997 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2c78442a-2ff4-4682-a013-73d4710d7094 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:44.545426 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2c78442a-2ff4-4682-a013-73d4710d7094 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:44.677052 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-2c78442a-2ff4-4682-a013-73d4710d7094 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:44.684635 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-2c78442a-2ff4-4682-a013-73d4710d7094 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1266 microversion: 2.1 time: 0.154219 Sep 20 22:32:44.685229 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 493/962] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:44 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:45.707298 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-1ffe80b5-b6c9-4e17-99fb-91290b85bcee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:45.707910 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-1ffe80b5-b6c9-4e17-99fb-91290b85bcee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:45.714245 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1ffe80b5-b6c9-4e17-99fb-91290b85bcee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:45.714732 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1ffe80b5-b6c9-4e17-99fb-91290b85bcee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:45.715162 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1ffe80b5-b6c9-4e17-99fb-91290b85bcee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:45.715848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1ffe80b5-b6c9-4e17-99fb-91290b85bcee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:45.716390 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1ffe80b5-b6c9-4e17-99fb-91290b85bcee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:45.716812 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-1ffe80b5-b6c9-4e17-99fb-91290b85bcee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:45.851722 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-1ffe80b5-b6c9-4e17-99fb-91290b85bcee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:45.860874 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-1ffe80b5-b6c9-4e17-99fb-91290b85bcee tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1266 microversion: 2.1 time: 0.157436 Sep 20 22:32:45.861717 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 470/963] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:45 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:46.883603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ffd54b13-e9c1-4423-bbbb-df7f4d0e9e2c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:46.884246 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-ffd54b13-e9c1-4423-bbbb-df7f4d0e9e2c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:46.891220 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ffd54b13-e9c1-4423-bbbb-df7f4d0e9e2c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:46.891697 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ffd54b13-e9c1-4423-bbbb-df7f4d0e9e2c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:46.892125 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ffd54b13-e9c1-4423-bbbb-df7f4d0e9e2c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:46.892807 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ffd54b13-e9c1-4423-bbbb-df7f4d0e9e2c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:46.893287 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ffd54b13-e9c1-4423-bbbb-df7f4d0e9e2c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:46.893709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-ffd54b13-e9c1-4423-bbbb-df7f4d0e9e2c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:47.023042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-ffd54b13-e9c1-4423-bbbb-df7f4d0e9e2c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:47.030707 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ffd54b13-e9c1-4423-bbbb-df7f4d0e9e2c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1266 microversion: 2.1 time: 0.150939 Sep 20 22:32:47.031271 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 494/964] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:46 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:47.388641 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-22fea182-2967-4a07-a437-f7b5818c1ca1 req-0aa65caf-e12c-4206-83bb-4f9dafbec5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da41d34-e3ba-4805-8662-2461d3b48ec0", "name": "network-vif-plugged", "status": "completed", "tag": "a06a3906-0bdb-4e5e-a8ce-e043710e1f6b"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:32:47.399802 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-22fea182-2967-4a07-a437-f7b5818c1ca1 req-0aa65caf-e12c-4206-83bb-4f9dafbec5e8 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:47.400296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-22fea182-2967-4a07-a437-f7b5818c1ca1 req-0aa65caf-e12c-4206-83bb-4f9dafbec5e8 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:47.401080 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-22fea182-2967-4a07-a437-f7b5818c1ca1 req-0aa65caf-e12c-4206-83bb-4f9dafbec5e8 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:47.411979 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-22fea182-2967-4a07-a437-f7b5818c1ca1 req-0aa65caf-e12c-4206-83bb-4f9dafbec5e8 service nova] Creating event network-vif-plugged:a06a3906-0bdb-4e5e-a8ce-e043710e1f6b for instance 0da41d34-e3ba-4805-8662-2461d3b48ec0 on hv-cinder-85827 Sep 20 22:32:47.417206 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-22fea182-2967-4a07-a437-f7b5818c1ca1 req-0aa65caf-e12c-4206-83bb-4f9dafbec5e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032336 Sep 20 22:32:47.417972 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 471/965] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:32:48.052786 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a37ed5c1-48cb-417f-8fa6-a8100d374cbc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:48.053426 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a37ed5c1-48cb-417f-8fa6-a8100d374cbc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:48.059858 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a37ed5c1-48cb-417f-8fa6-a8100d374cbc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:48.060342 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a37ed5c1-48cb-417f-8fa6-a8100d374cbc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:48.060779 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a37ed5c1-48cb-417f-8fa6-a8100d374cbc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:48.061499 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a37ed5c1-48cb-417f-8fa6-a8100d374cbc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:48.061949 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a37ed5c1-48cb-417f-8fa6-a8100d374cbc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:48.062366 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a37ed5c1-48cb-417f-8fa6-a8100d374cbc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:48.191420 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a37ed5c1-48cb-417f-8fa6-a8100d374cbc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:48.198932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a37ed5c1-48cb-417f-8fa6-a8100d374cbc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1266 microversion: 2.1 time: 0.149997 Sep 20 22:32:48.199491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 495/966] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:48 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:32:49.223042 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-bcaf3f37-2579-430a-a907-efb211d69e0f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:49.223737 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-bcaf3f37-2579-430a-a907-efb211d69e0f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:49.230418 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bcaf3f37-2579-430a-a907-efb211d69e0f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:49.230912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bcaf3f37-2579-430a-a907-efb211d69e0f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:49.231349 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bcaf3f37-2579-430a-a907-efb211d69e0f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:49.232686 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bcaf3f37-2579-430a-a907-efb211d69e0f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:49.233187 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bcaf3f37-2579-430a-a907-efb211d69e0f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:49.233617 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bcaf3f37-2579-430a-a907-efb211d69e0f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:49.363916 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-bcaf3f37-2579-430a-a907-efb211d69e0f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:49.372058 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-bcaf3f37-2579-430a-a907-efb211d69e0f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1454 microversion: 2.1 time: 0.153424 Sep 20 22:32:49.372627 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 472/967] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:49 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:32:49.393922 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-d14d763e-9d15-446c-8cc2-dd68ec45b6b0 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:49.394538 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-d14d763e-9d15-446c-8cc2-dd68ec45b6b0 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:49.401003 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d14d763e-9d15-446c-8cc2-dd68ec45b6b0 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:49.401506 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d14d763e-9d15-446c-8cc2-dd68ec45b6b0 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:49.401949 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d14d763e-9d15-446c-8cc2-dd68ec45b6b0 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:49.402635 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d14d763e-9d15-446c-8cc2-dd68ec45b6b0 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:49.403099 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d14d763e-9d15-446c-8cc2-dd68ec45b6b0 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:49.404045 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-d14d763e-9d15-446c-8cc2-dd68ec45b6b0 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:49.537578 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-d14d763e-9d15-446c-8cc2-dd68ec45b6b0 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:49.545177 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-d14d763e-9d15-446c-8cc2-dd68ec45b6b0 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1454 microversion: 2.1 time: 0.155062 Sep 20 22:32:49.545739 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 496/968] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:49 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:51.322674 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-b93ade5f-a9e5-4bb6-abb4-ea557913dce6 req-d17ac9c9-11df-44fa-85cc-caaf4e9b61a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0da41d34-e3ba-4805-8662-2461d3b48ec0", "tag": "a06a3906-0bdb-4e5e-a8ce-e043710e1f6b"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:32:51.332850 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-b93ade5f-a9e5-4bb6-abb4-ea557913dce6 req-d17ac9c9-11df-44fa-85cc-caaf4e9b61a6 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:51.333379 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-b93ade5f-a9e5-4bb6-abb4-ea557913dce6 req-d17ac9c9-11df-44fa-85cc-caaf4e9b61a6 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:51.333813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-b93ade5f-a9e5-4bb6-abb4-ea557913dce6 req-d17ac9c9-11df-44fa-85cc-caaf4e9b61a6 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:51.345157 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-b93ade5f-a9e5-4bb6-abb4-ea557913dce6 req-d17ac9c9-11df-44fa-85cc-caaf4e9b61a6 service nova] Creating event network-changed:a06a3906-0bdb-4e5e-a8ce-e043710e1f6b for instance 0da41d34-e3ba-4805-8662-2461d3b48ec0 on hv-cinder-85827 Sep 20 22:32:51.350363 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-b93ade5f-a9e5-4bb6-abb4-ea557913dce6 req-d17ac9c9-11df-44fa-85cc-caaf4e9b61a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031380 Sep 20 22:32:51.350978 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 473/969] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:32:53.472989 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-674b14e1-e8cb-4258-961e-2a1f91970cfc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1749188434"}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:32:53.473514 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-674b14e1-e8cb-4258-961e-2a1f91970cfc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:53.479800 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-674b14e1-e8cb-4258-961e-2a1f91970cfc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:53.480274 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-674b14e1-e8cb-4258-961e-2a1f91970cfc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:53.480700 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-674b14e1-e8cb-4258-961e-2a1f91970cfc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:53.481408 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-674b14e1-e8cb-4258-961e-2a1f91970cfc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:53.484225 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-674b14e1-e8cb-4258-961e-2a1f91970cfc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:53.484651 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-674b14e1-e8cb-4258-961e-2a1f91970cfc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:53.607653 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.network.security_group_api [None req-674b14e1-e8cb-4258-961e-2a1f91970cfc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Removing security group 900f5927-f727-4010-8262-9cabbc02c542 from port 2c27dc78-c19b-4ad9-b5ae-35688f10f1a8 Sep 20 22:32:53.910771 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-674b14e1-e8cb-4258-961e-2a1f91970cfc tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "POST /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553/action" status: 202 len: 0 microversion: 2.1 time: 0.441791 Sep 20 22:32:53.911392 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 497/970] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 20 22:32:53 2022] POST /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:32:53.922894 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-85878ebf-2c55-4b7b-aead-ba6e09effa86 req-0d02e8cc-e257-4b7c-ba3d-e8c0d3e2cea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c51ac84a-e21e-470f-b1c4-c542a1b8f553", "tag": "2c27dc78-c19b-4ad9-b5ae-35688f10f1a8"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:32:53.934628 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-85878ebf-2c55-4b7b-aead-ba6e09effa86 req-0d02e8cc-e257-4b7c-ba3d-e8c0d3e2cea7 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:53.935469 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-85878ebf-2c55-4b7b-aead-ba6e09effa86 req-0d02e8cc-e257-4b7c-ba3d-e8c0d3e2cea7 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:53.936180 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-85878ebf-2c55-4b7b-aead-ba6e09effa86 req-0d02e8cc-e257-4b7c-ba3d-e8c0d3e2cea7 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:53.947673 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-85878ebf-2c55-4b7b-aead-ba6e09effa86 req-0d02e8cc-e257-4b7c-ba3d-e8c0d3e2cea7 service nova] Creating event network-changed:2c27dc78-c19b-4ad9-b5ae-35688f10f1a8 for instance c51ac84a-e21e-470f-b1c4-c542a1b8f553 on hv-cinder-85827 Sep 20 22:32:53.953337 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-85878ebf-2c55-4b7b-aead-ba6e09effa86 req-0d02e8cc-e257-4b7c-ba3d-e8c0d3e2cea7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036119 Sep 20 22:32:53.954502 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 474/971] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:32:55.101233 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9c3f6604-dabf-498f-b935-d6afcf4409d2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:55.101718 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9c3f6604-dabf-498f-b935-d6afcf4409d2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:55.107709 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9c3f6604-dabf-498f-b935-d6afcf4409d2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:55.108190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9c3f6604-dabf-498f-b935-d6afcf4409d2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:55.108618 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9c3f6604-dabf-498f-b935-d6afcf4409d2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:55.109338 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9c3f6604-dabf-498f-b935-d6afcf4409d2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:55.109788 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9c3f6604-dabf-498f-b935-d6afcf4409d2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:55.110204 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9c3f6604-dabf-498f-b935-d6afcf4409d2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:55.190973 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-9c3f6604-dabf-498f-b935-d6afcf4409d2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lazy-loading 'services' on Instance uuid c51ac84a-e21e-470f-b1c4-c542a1b8f553 {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:32:55.264995 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-9c3f6604-dabf-498f-b935-d6afcf4409d2 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553/os-volume_attachments/e21aa185-e564-4277-9c64-95522244e756" status: 202 len: 0 microversion: 2.1 time: 0.168082 Sep 20 22:32:55.265646 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 498/972] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 20 22:32:55 2022] DELETE /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553/os-volume_attachments/e21aa185-e564-4277-9c64-95522244e756 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:32:55.276097 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0565c704-92d9-4afb-a49c-9d9e85c0c7a9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:55.278824 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-0565c704-92d9-4afb-a49c-9d9e85c0c7a9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:55.286490 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0565c704-92d9-4afb-a49c-9d9e85c0c7a9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:55.287721 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0565c704-92d9-4afb-a49c-9d9e85c0c7a9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:55.288375 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0565c704-92d9-4afb-a49c-9d9e85c0c7a9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:55.289310 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0565c704-92d9-4afb-a49c-9d9e85c0c7a9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:55.289773 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0565c704-92d9-4afb-a49c-9d9e85c0c7a9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:55.290203 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0565c704-92d9-4afb-a49c-9d9e85c0c7a9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:55.329815 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-0565c704-92d9-4afb-a49c-9d9e85c0c7a9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058992 Sep 20 22:32:55.330757 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 475/973] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:32:55 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:32:55.973318 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-1bb80db1-6a8f-47e8-8b7a-9e32e8346935 req-63b86c38-ff57-4b26-8f81-3e5252fec2bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c51ac84a-e21e-470f-b1c4-c542a1b8f553", "tag": "2c27dc78-c19b-4ad9-b5ae-35688f10f1a8"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:32:55.983835 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-1bb80db1-6a8f-47e8-8b7a-9e32e8346935 req-63b86c38-ff57-4b26-8f81-3e5252fec2bf service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:55.984401 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-1bb80db1-6a8f-47e8-8b7a-9e32e8346935 req-63b86c38-ff57-4b26-8f81-3e5252fec2bf service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:55.984733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-1bb80db1-6a8f-47e8-8b7a-9e32e8346935 req-63b86c38-ff57-4b26-8f81-3e5252fec2bf service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:55.996458 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-1bb80db1-6a8f-47e8-8b7a-9e32e8346935 req-63b86c38-ff57-4b26-8f81-3e5252fec2bf service nova] Creating event network-changed:2c27dc78-c19b-4ad9-b5ae-35688f10f1a8 for instance c51ac84a-e21e-470f-b1c4-c542a1b8f553 on hv-cinder-85827 Sep 20 22:32:56.002244 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-1bb80db1-6a8f-47e8-8b7a-9e32e8346935 req-63b86c38-ff57-4b26-8f81-3e5252fec2bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032853 Sep 20 22:32:56.002852 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 499/974] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:32:56.343347 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-bae12b58-ee01-4a4f-9be3-50171ef3526c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:56.345599 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-bae12b58-ee01-4a4f-9be3-50171ef3526c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:56.351985 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bae12b58-ee01-4a4f-9be3-50171ef3526c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:56.352469 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bae12b58-ee01-4a4f-9be3-50171ef3526c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:56.352899 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bae12b58-ee01-4a4f-9be3-50171ef3526c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:56.353613 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bae12b58-ee01-4a4f-9be3-50171ef3526c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:56.354060 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bae12b58-ee01-4a4f-9be3-50171ef3526c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:56.354483 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-bae12b58-ee01-4a4f-9be3-50171ef3526c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:56.385777 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-bae12b58-ee01-4a4f-9be3-50171ef3526c tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046957 Sep 20 22:32:56.386346 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 476/975] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:32:56 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 20 22:32:56.398372 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4aec52cb-a67e-497d-965f-7e8161e12cdb tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:56.398961 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4aec52cb-a67e-497d-965f-7e8161e12cdb tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:56.405647 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4aec52cb-a67e-497d-965f-7e8161e12cdb tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:56.406130 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4aec52cb-a67e-497d-965f-7e8161e12cdb tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:56.406564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4aec52cb-a67e-497d-965f-7e8161e12cdb tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:56.407251 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4aec52cb-a67e-497d-965f-7e8161e12cdb tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:56.407702 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4aec52cb-a67e-497d-965f-7e8161e12cdb tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:56.408123 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4aec52cb-a67e-497d-965f-7e8161e12cdb tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:56.482686 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-4aec52cb-a67e-497d-965f-7e8161e12cdb tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] HTTP exception thrown: Instance c51ac84a-e21e-470f-b1c4-c542a1b8f553 is not attached to volume e21aa185-e564-4277-9c64-95522244e756 Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4aec52cb-a67e-497d-965f-7e8161e12cdb tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Request method failure captured: Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: DELETE /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553/os-volume_attachments/e21aa185-e564-4277-9c64-95522244e756 HTTP/1.1 Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj8DIfYnw_fKttivgT7ESw-0AiawGrFPUYpOoyneIkNKdqdeuSMJ1uJVx_Ai4a0PKdhH_7nCjc22_nOGcx0Q-RvV5xplhWU4Rk5cE2vZh4-Y6cg-myZqMnYE09jveMppyMQffiEGDZ8wx0l8qnr0xx4Ju9hbbR2KM5rII2AKDl4kPnU Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 021bf48fb20347f8bb6664c066b2c93f Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-TestMinimumBasicScenario-2014029436 Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:32:56.485088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:32:56.486776 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/021bf48fb20347f8bb6664c066b2c93f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_021bf48fb20347f8bb6664c066b2c93f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/021bf48fb20347f8bb6664c066b2c93f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/021bf48fb20347f8bb6664c066b2c93f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:32:56.486776 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-TestMinimumBasicScenario-2014029436 Sep 20 22:32:56.486776 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 021bf48fb20347f8bb6664c066b2c93f Sep 20 22:32:56.486776 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2014029436 Sep 20 22:32:56.486776 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-TestMinimumBasicScenario-2014029436-project Sep 20 22:32:56.486776 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:32:56.486776 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:32:56.486776 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: fd496dcf230b4cd5b5eb514103c55005 Sep 20 22:32:56.486776 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-TestMinimumBasicScenario-2014029436-project Sep 20 22:32:56.486776 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:32:56.486776 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance c51ac84a-e21e-470f-b1c4-c542a1b8f553 is not attached to volume e21aa185-e564-4277-9c64-95522244e756 Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'server_id': 'c51ac84a-e21e-470f-b1c4-c542a1b8f553', 'id': 'e21aa185-e564-4277-9c64-95522244e756'} Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e21aa185-e564-4277-9c64-95522244e756. Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:32:56.487757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:32:56.489266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:32:56.489266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 20 22:32:56.489266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 20 22:32:56.489266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c51ac84a-e21e-470f-b1c4-c542a1b8f553 is not attached to volume e21aa185-e564-4277-9c64-95522244e756 Sep 20 22:32:56.489266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:32:56.489266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:32:56.489266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:32:56.489266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:32:56.489266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:32:56.489266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:32:56.489266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:32:56.489266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:32:56.489266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c51ac84a-e21e-470f-b1c4-c542a1b8f553 is not attached to volume e21aa185-e564-4277-9c64-95522244e756 Sep 20 22:32:56.489266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:32:56.489266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4aec52cb-a67e-497d-965f-7e8161e12cdb tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Returning 404 to user: Instance c51ac84a-e21e-470f-b1c4-c542a1b8f553 is not attached to volume e21aa185-e564-4277-9c64-95522244e756 {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:32:56.490512 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4aec52cb-a67e-497d-965f-7e8161e12cdb tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553/os-volume_attachments/e21aa185-e564-4277-9c64-95522244e756" status: 404 len: 154 microversion: 2.1 time: 0.092976 Sep 20 22:32:56.490512 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 500/976] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 20 22:32:56 2022] DELETE /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553/os-volume_attachments/e21aa185-e564-4277-9c64-95522244e756 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:32:57.628556 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-520a2b9a-4374-4f43-b747-2aa457cd45e9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:57.629093 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-520a2b9a-4374-4f43-b747-2aa457cd45e9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:57.635305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-520a2b9a-4374-4f43-b747-2aa457cd45e9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:57.635780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-520a2b9a-4374-4f43-b747-2aa457cd45e9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:57.636210 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-520a2b9a-4374-4f43-b747-2aa457cd45e9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:57.636891 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-520a2b9a-4374-4f43-b747-2aa457cd45e9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:57.637367 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-520a2b9a-4374-4f43-b747-2aa457cd45e9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:57.637848 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-520a2b9a-4374-4f43-b747-2aa457cd45e9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:57.662574 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-520a2b9a-4374-4f43-b747-2aa457cd45e9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Going to try to terminate instance {{(pid=120473) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:32:57.710808 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:57.738805 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-520a2b9a-4374-4f43-b747-2aa457cd45e9 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 204 len: 0 microversion: 2.1 time: 0.113546 Sep 20 22:32:57.739729 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 477/977] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:32:57 2022] DELETE /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:32:57.748897 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-2a95951e-8275-42b0-affe-4a0cac478b09 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:57.749563 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-2a95951e-8275-42b0-affe-4a0cac478b09 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:57.755935 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2a95951e-8275-42b0-affe-4a0cac478b09 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:57.756419 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2a95951e-8275-42b0-affe-4a0cac478b09 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:57.756854 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2a95951e-8275-42b0-affe-4a0cac478b09 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:57.757571 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2a95951e-8275-42b0-affe-4a0cac478b09 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:57.758035 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2a95951e-8275-42b0-affe-4a0cac478b09 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:57.758457 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-2a95951e-8275-42b0-affe-4a0cac478b09 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:57.890107 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-2a95951e-8275-42b0-affe-4a0cac478b09 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:57.897836 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-2a95951e-8275-42b0-affe-4a0cac478b09 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1553 microversion: 2.1 time: 0.153689 Sep 20 22:32:57.898416 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 501/978] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:57 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:58.921392 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-df471745-4778-4386-be76-d707a18b3d82 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:32:58.922093 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-df471745-4778-4386-be76-d707a18b3d82 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:32:58.928388 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-df471745-4778-4386-be76-d707a18b3d82 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:58.928866 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-df471745-4778-4386-be76-d707a18b3d82 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:58.929330 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-df471745-4778-4386-be76-d707a18b3d82 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:58.930014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-df471745-4778-4386-be76-d707a18b3d82 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:58.930462 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-df471745-4778-4386-be76-d707a18b3d82 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:58.930882 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-df471745-4778-4386-be76-d707a18b3d82 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:59.056698 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-df471745-4778-4386-be76-d707a18b3d82 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:32:59.064994 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-df471745-4778-4386-be76-d707a18b3d82 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1553 microversion: 2.1 time: 0.147949 Sep 20 22:32:59.065570 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 478/979] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:32:58 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:32:59.973845 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-63244070-bbb9-4073-9636-319343470e43 req-f7978dba-8c6e-4284-a974-412c9985d5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c51ac84a-e21e-470f-b1c4-c542a1b8f553", "name": "network-vif-deleted", "tag": "2c27dc78-c19b-4ad9-b5ae-35688f10f1a8"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:32:59.986178 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-63244070-bbb9-4073-9636-319343470e43 req-f7978dba-8c6e-4284-a974-412c9985d5f8 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:32:59.986748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-63244070-bbb9-4073-9636-319343470e43 req-f7978dba-8c6e-4284-a974-412c9985d5f8 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:32:59.987110 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-63244070-bbb9-4073-9636-319343470e43 req-f7978dba-8c6e-4284-a974-412c9985d5f8 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:32:59.991287 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:00.001287 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-63244070-bbb9-4073-9636-319343470e43 req-f7978dba-8c6e-4284-a974-412c9985d5f8 service nova] Creating event network-vif-deleted:2c27dc78-c19b-4ad9-b5ae-35688f10f1a8 for instance c51ac84a-e21e-470f-b1c4-c542a1b8f553 on hv-cinder-85827 Sep 20 22:33:00.006779 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-63244070-bbb9-4073-9636-319343470e43 req-f7978dba-8c6e-4284-a974-412c9985d5f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036560 Sep 20 22:33:00.007384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 502/980] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:33:00.090285 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-6bcfd0bf-405a-4004-8c82-f6461c716988 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:00.091635 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-6bcfd0bf-405a-4004-8c82-f6461c716988 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:00.097885 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6bcfd0bf-405a-4004-8c82-f6461c716988 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:00.098375 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6bcfd0bf-405a-4004-8c82-f6461c716988 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:00.098810 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6bcfd0bf-405a-4004-8c82-f6461c716988 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:00.099510 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6bcfd0bf-405a-4004-8c82-f6461c716988 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:00.099978 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6bcfd0bf-405a-4004-8c82-f6461c716988 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:00.100393 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6bcfd0bf-405a-4004-8c82-f6461c716988 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:00.130674 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6bcfd0bf-405a-4004-8c82-f6461c716988 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:00.131165 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6bcfd0bf-405a-4004-8c82-f6461c716988 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:00.131599 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-6bcfd0bf-405a-4004-8c82-f6461c716988 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:00.132045 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-6bcfd0bf-405a-4004-8c82-f6461c716988 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lazy-loading 'fault' on Instance uuid c51ac84a-e21e-470f-b1c4-c542a1b8f553 {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:33:00.175110 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-6bcfd0bf-405a-4004-8c82-f6461c716988 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd496dcf230b4cd5b5eb514103c55005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021bf48fb20347f8bb6664c066b2c93f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:33:00.182862 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-6bcfd0bf-405a-4004-8c82-f6461c716988 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 200 len: 1348 microversion: 2.1 time: 0.097011 Sep 20 22:33:00.183611 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 479/981] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:00 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:33:01.207665 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-87f0eac7-8377-4bdd-a576-045424ac0dcf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:01.208388 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-87f0eac7-8377-4bdd-a576-045424ac0dcf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] [instance: c51ac84a-e21e-470f-b1c4-c542a1b8f553] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:01.214414 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-87f0eac7-8377-4bdd-a576-045424ac0dcf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:01.214891 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-87f0eac7-8377-4bdd-a576-045424ac0dcf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:01.215320 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-87f0eac7-8377-4bdd-a576-045424ac0dcf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:01.216506 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-87f0eac7-8377-4bdd-a576-045424ac0dcf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:01.216951 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-87f0eac7-8377-4bdd-a576-045424ac0dcf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:01.217393 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-87f0eac7-8377-4bdd-a576-045424ac0dcf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:01.232312 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-87f0eac7-8377-4bdd-a576-045424ac0dcf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] HTTP exception thrown: Instance c51ac84a-e21e-470f-b1c4-c542a1b8f553 could not be found. Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-87f0eac7-8377-4bdd-a576-045424ac0dcf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Request method failure captured: Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 HTTP/1.1 Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj8DIfYnw_fKttivgT7ESw-0AiawGrFPUYpOoyneIkNKdqdeuSMJ1uJVx_Ai4a0PKdhH_7nCjc22_nOGcx0Q-RvV5xplhWU4Rk5cE2vZh4-Y6cg-myZqMnYE09jveMppyMQffiEGDZ8wx0l8qnr0xx4Ju9hbbR2KM5rII2AKDl4kPnU Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 021bf48fb20347f8bb6664c066b2c93f Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-TestMinimumBasicScenario-2014029436 Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:33:01.233915 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:33:01.235525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/021bf48fb20347f8bb6664c066b2c93f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_021bf48fb20347f8bb6664c066b2c93f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/021bf48fb20347f8bb6664c066b2c93f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/021bf48fb20347f8bb6664c066b2c93f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:33:01.235525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-TestMinimumBasicScenario-2014029436 Sep 20 22:33:01.235525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 021bf48fb20347f8bb6664c066b2c93f Sep 20 22:33:01.235525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2014029436 Sep 20 22:33:01.235525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-TestMinimumBasicScenario-2014029436-project Sep 20 22:33:01.235525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:33:01.235525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:33:01.235525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: fd496dcf230b4cd5b5eb514103c55005 Sep 20 22:33:01.235525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-TestMinimumBasicScenario-2014029436-project Sep 20 22:33:01.235525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:33:01.235525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance c51ac84a-e21e-470f-b1c4-c542a1b8f553 could not be found. Sep 20 22:33:01.235525 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': 'c51ac84a-e21e-470f-b1c4-c542a1b8f553'} Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c51ac84a-e21e-470f-b1c4-c542a1b8f553 could not be found. Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:33:01.236564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:33:01.238111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:33:01.238111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:33:01.238111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:33:01.238111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:33:01.238111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:33:01.238111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:33:01.238111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:33:01.238111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c51ac84a-e21e-470f-b1c4-c542a1b8f553 could not be found. Sep 20 22:33:01.238111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:33:01.238111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:33:01.238111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:33:01.238111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:33:01.238111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:33:01.238111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:33:01.238111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:33:01.238111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:33:01.238111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c51ac84a-e21e-470f-b1c4-c542a1b8f553 could not be found. Sep 20 22:33:01.238111 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:33:01.239560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-87f0eac7-8377-4bdd-a576-045424ac0dcf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Returning 404 to user: Instance c51ac84a-e21e-470f-b1c4-c542a1b8f553 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:33:01.239560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-87f0eac7-8377-4bdd-a576-045424ac0dcf tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553" status: 404 len: 111 microversion: 2.1 time: 0.032592 Sep 20 22:33:01.239560 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 503/982] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:01 2022] GET /compute/v2.1/servers/c51ac84a-e21e-470f-b1c4-c542a1b8f553 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:33:01.244176 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-2e1d5dbc-c9a8-4339-b035-f8c4516884c7 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] Calling method '.version_select at 0x7f24f673a430>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:01.262194 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-2e1d5dbc-c9a8-4339-b035-f8c4516884c7 tempest-TestMinimumBasicScenario-2014029436 tempest-TestMinimumBasicScenario-2014029436-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-956717486" status: 202 len: 0 microversion: 2.1 time: 0.022048 Sep 20 22:33:01.262746 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 480/983] 10.222.0.16 () {58 vars in 1269 bytes} [Tue Sep 20 22:33:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-956717486 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:33:16.492932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5927a7fa-650c-4e05-9479-29996a4b02b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:16.493456 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5927a7fa-650c-4e05-9479-29996a4b02b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:16.495826 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=43 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:16.496475 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=3 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:16.502455 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5927a7fa-650c-4e05-9479-29996a4b02b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:16.502939 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5927a7fa-650c-4e05-9479-29996a4b02b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:16.503370 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5927a7fa-650c-4e05-9479-29996a4b02b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:16.504056 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5927a7fa-650c-4e05-9479-29996a4b02b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:16.504506 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5927a7fa-650c-4e05-9479-29996a4b02b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:16.504926 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5927a7fa-650c-4e05-9479-29996a4b02b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:16.528732 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5927a7fa-650c-4e05-9479-29996a4b02b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652/ips" status: 200 len: 150 microversion: 2.1 time: 0.039867 Sep 20 22:33:16.529517 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 504/984] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 20 22:33:16 2022] GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:33:16.538544 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=14 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:16.539279 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:16.543986 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-9425a03d-beb4-4827-9101-9e85bae45de2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "feed8368-3333-49ea-a8a8-eceb1d7cd5d2"}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:33:16.546925 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-9425a03d-beb4-4827-9101-9e85bae45de2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:16.555038 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9425a03d-beb4-4827-9101-9e85bae45de2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:16.555518 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9425a03d-beb4-4827-9101-9e85bae45de2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:16.555952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9425a03d-beb4-4827-9101-9e85bae45de2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:16.556697 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9425a03d-beb4-4827-9101-9e85bae45de2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:16.557175 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9425a03d-beb4-4827-9101-9e85bae45de2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:16.557600 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9425a03d-beb4-4827-9101-9e85bae45de2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:16.636567 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-9425a03d-beb4-4827-9101-9e85bae45de2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] HTTP exception thrown: Invalid volume: volume feed8368-3333-49ea-a8a8-eceb1d7cd5d2 is already attached to instances: ef067608-a015-4521-8a76-e5aeba165960 Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-9425a03d-beb4-4827-9101-9e85bae45de2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Request method failure captured: Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: POST /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652/os-volume_attachments HTTP/1.1 Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 74 Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj9Aeyxjf5yMqHjDnCvmmvzhWQGzCrsBQuX_13kvowH7Ss-qoNBJb-Gfzs2nh_Wxq8YsnyXcveK6Mf9KXU9rYT6WvCgM2KCRhWvNuoaiFUsmz4N6dsiGMTW1t41Prgmfndkff0JZfffcZEBsySI2HYoAQ7I1a7TgST0Ce1eGA0Ik8Kw Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:33:16.638320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:33:16.639972 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59af02f2b4984c6190870041aa020d75", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59af02f2b4984c6190870041aa020d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:33:16.639972 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:33:16.639972 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:33:16.639972 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:33:16.639972 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:33:16.639972 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:33:16.639972 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:33:16.639972 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 4af67f949fda43bf8967925f04491bd8 Sep 20 22:33:16.639972 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:33:16.639972 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Sep 20 22:33:16.639972 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {"volumeAttachment": {"volumeId": "feed8368-3333-49ea-a8a8-eceb1d7cd5d2"}} Sep 20 22:33:16.639972 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Invalid volume: volume feed8368-3333-49ea-a8a8-eceb1d7cd5d2 is already attached to instances: ef067608-a015-4521-8a76-e5aeba165960 Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'server_id': 'f8c1229b-9470-4d8f-8451-6fc1e718b652', 'body': {'volumeAttachment': {'volumeId': 'feed8368-3333-49ea-a8a8-eceb1d7cd5d2'}}} Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume feed8368-3333-49ea-a8a8-eceb1d7cd5d2 is already attached to instances: ef067608-a015-4521-8a76-e5aeba165960 Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:33:16.641081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume feed8368-3333-49ea-a8a8-eceb1d7cd5d2 is already attached to instances: ef067608-a015-4521-8a76-e5aeba165960 Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:33:16.642648 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:33:16.644271 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:33:16.644271 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:33:16.644271 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:33:16.644271 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume feed8368-3333-49ea-a8a8-eceb1d7cd5d2 is already attached to instances: ef067608-a015-4521-8a76-e5aeba165960 Sep 20 22:33:16.644271 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:33:16.644271 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-9425a03d-beb4-4827-9101-9e85bae45de2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Returning 400 to user: Invalid volume: volume feed8368-3333-49ea-a8a8-eceb1d7cd5d2 is already attached to instances: ef067608-a015-4521-8a76-e5aeba165960 {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:33:16.644271 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-9425a03d-beb4-4827-9101-9e85bae45de2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "POST /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102774 Sep 20 22:33:16.644271 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 481/985] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 20 22:33:16 2022] POST /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 20 22:33:16.648561 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4eab6907-d732-4ad0-b57c-e20da857d397 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:16.649075 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4eab6907-d732-4ad0-b57c-e20da857d397 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:16.654953 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4eab6907-d732-4ad0-b57c-e20da857d397 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:16.655436 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4eab6907-d732-4ad0-b57c-e20da857d397 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:16.655865 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4eab6907-d732-4ad0-b57c-e20da857d397 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:16.656543 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4eab6907-d732-4ad0-b57c-e20da857d397 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:16.657009 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4eab6907-d732-4ad0-b57c-e20da857d397 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:16.657435 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4eab6907-d732-4ad0-b57c-e20da857d397 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:16.682403 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4eab6907-d732-4ad0-b57c-e20da857d397 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Going to try to terminate instance {{(pid=120474) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:33:16.757691 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4eab6907-d732-4ad0-b57c-e20da857d397 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652" status: 204 len: 0 microversion: 2.1 time: 0.112663 Sep 20 22:33:16.758521 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 505/986] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:33:16 2022] DELETE /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:33:16.766914 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c5714fa7-a9c4-4402-8ae6-135f6a852c55 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:16.767539 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c5714fa7-a9c4-4402-8ae6-135f6a852c55 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:16.774653 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c5714fa7-a9c4-4402-8ae6-135f6a852c55 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:16.775012 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c5714fa7-a9c4-4402-8ae6-135f6a852c55 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:16.775494 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c5714fa7-a9c4-4402-8ae6-135f6a852c55 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:16.776197 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c5714fa7-a9c4-4402-8ae6-135f6a852c55 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:16.776654 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c5714fa7-a9c4-4402-8ae6-135f6a852c55 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:16.777102 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c5714fa7-a9c4-4402-8ae6-135f6a852c55 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:16.905210 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c5714fa7-a9c4-4402-8ae6-135f6a852c55 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:33:16.913314 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-c5714fa7-a9c4-4402-8ae6-135f6a852c55 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652" status: 200 len: 1681 microversion: 2.1 time: 0.150305 Sep 20 22:33:16.913885 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 482/987] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:16 2022] GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:33:17.937580 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4c1785c5-b71f-45b3-bbff-b7590c7f9f58 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:17.938288 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4c1785c5-b71f-45b3-bbff-b7590c7f9f58 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:17.944743 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4c1785c5-b71f-45b3-bbff-b7590c7f9f58 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:17.945266 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4c1785c5-b71f-45b3-bbff-b7590c7f9f58 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:17.945705 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4c1785c5-b71f-45b3-bbff-b7590c7f9f58 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:17.946397 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4c1785c5-b71f-45b3-bbff-b7590c7f9f58 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:17.946856 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4c1785c5-b71f-45b3-bbff-b7590c7f9f58 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:17.947282 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4c1785c5-b71f-45b3-bbff-b7590c7f9f58 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:18.079683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-4c1785c5-b71f-45b3-bbff-b7590c7f9f58 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:33:18.087387 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4c1785c5-b71f-45b3-bbff-b7590c7f9f58 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652" status: 200 len: 1681 microversion: 2.1 time: 0.154153 Sep 20 22:33:18.087968 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 506/988] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:17 2022] GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:33:18.973407 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-13fa6d8b-b972-4051-9f80-b1efa7ee57f3 req-90d679af-6b4b-49af-ba8c-a8e323b554ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8c1229b-9470-4d8f-8451-6fc1e718b652", "name": "network-vif-deleted", "tag": "093b362f-098e-4d4d-84e5-a8dcd1760122"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:33:18.985810 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-13fa6d8b-b972-4051-9f80-b1efa7ee57f3 req-90d679af-6b4b-49af-ba8c-a8e323b554ed service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:18.986284 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-13fa6d8b-b972-4051-9f80-b1efa7ee57f3 req-90d679af-6b4b-49af-ba8c-a8e323b554ed service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:18.986704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-13fa6d8b-b972-4051-9f80-b1efa7ee57f3 req-90d679af-6b4b-49af-ba8c-a8e323b554ed service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:19.000434 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-13fa6d8b-b972-4051-9f80-b1efa7ee57f3 req-90d679af-6b4b-49af-ba8c-a8e323b554ed service nova] Creating event network-vif-deleted:093b362f-098e-4d4d-84e5-a8dcd1760122 for instance f8c1229b-9470-4d8f-8451-6fc1e718b652 on hv-cinder-85827 Sep 20 22:33:19.005386 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-13fa6d8b-b972-4051-9f80-b1efa7ee57f3 req-90d679af-6b4b-49af-ba8c-a8e323b554ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035911 Sep 20 22:33:19.005978 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 483/989] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:33:19.112762 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3632049f-7f66-47c1-83d9-da67cd05e621 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:19.113409 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-3632049f-7f66-47c1-83d9-da67cd05e621 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:19.124025 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3632049f-7f66-47c1-83d9-da67cd05e621 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:19.124773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3632049f-7f66-47c1-83d9-da67cd05e621 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:19.125757 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3632049f-7f66-47c1-83d9-da67cd05e621 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:19.126551 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3632049f-7f66-47c1-83d9-da67cd05e621 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:19.127116 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3632049f-7f66-47c1-83d9-da67cd05e621 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:19.127644 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3632049f-7f66-47c1-83d9-da67cd05e621 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:19.178329 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3632049f-7f66-47c1-83d9-da67cd05e621 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:19.179234 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3632049f-7f66-47c1-83d9-da67cd05e621 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:19.179892 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3632049f-7f66-47c1-83d9-da67cd05e621 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:19.180575 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-3632049f-7f66-47c1-83d9-da67cd05e621 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lazy-loading 'fault' on Instance uuid f8c1229b-9470-4d8f-8451-6fc1e718b652 {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:33:19.226640 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3632049f-7f66-47c1-83d9-da67cd05e621 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:33:19.235217 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-3632049f-7f66-47c1-83d9-da67cd05e621 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652" status: 200 len: 1330 microversion: 2.1 time: 0.126571 Sep 20 22:33:19.235803 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 507/990] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:19 2022] GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 => generated 1330 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:33:20.259316 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-cee3c95c-86a6-408c-b2a1-35ca228fe67c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:20.260039 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-cee3c95c-86a6-408c-b2a1-35ca228fe67c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:20.266813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cee3c95c-86a6-408c-b2a1-35ca228fe67c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:20.267288 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cee3c95c-86a6-408c-b2a1-35ca228fe67c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:20.267728 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cee3c95c-86a6-408c-b2a1-35ca228fe67c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:20.268410 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cee3c95c-86a6-408c-b2a1-35ca228fe67c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:20.268861 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cee3c95c-86a6-408c-b2a1-35ca228fe67c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:20.269308 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-cee3c95c-86a6-408c-b2a1-35ca228fe67c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:20.282133 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-cee3c95c-86a6-408c-b2a1-35ca228fe67c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] HTTP exception thrown: Instance f8c1229b-9470-4d8f-8451-6fc1e718b652 could not be found. Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-cee3c95c-86a6-408c-b2a1-35ca228fe67c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Request method failure captured: Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 HTTP/1.1 Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj9Aeyxjf5yMqHjDnCvmmvzhWQGzCrsBQuX_13kvowH7Ss-qoNBJb-Gfzs2nh_Wxq8YsnyXcveK6Mf9KXU9rYT6WvCgM2KCRhWvNuoaiFUsmz4N6dsiGMTW1t41Prgmfndkff0JZfffcZEBsySI2HYoAQ7I1a7TgST0Ce1eGA0Ik8Kw Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:33:20.283741 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:33:20.285390 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59af02f2b4984c6190870041aa020d75", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59af02f2b4984c6190870041aa020d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:33:20.285390 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:33:20.285390 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:33:20.285390 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:33:20.285390 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:33:20.285390 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:33:20.285390 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:33:20.285390 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 4af67f949fda43bf8967925f04491bd8 Sep 20 22:33:20.285390 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:33:20.285390 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:33:20.285390 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance f8c1229b-9470-4d8f-8451-6fc1e718b652 could not be found. Sep 20 22:33:20.285390 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': 'f8c1229b-9470-4d8f-8451-6fc1e718b652'} Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8c1229b-9470-4d8f-8451-6fc1e718b652 could not be found. Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:33:20.286296 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:33:20.287908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:33:20.287908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:33:20.287908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:33:20.287908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:33:20.287908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:33:20.287908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:33:20.287908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:33:20.287908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8c1229b-9470-4d8f-8451-6fc1e718b652 could not be found. Sep 20 22:33:20.287908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:33:20.287908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:33:20.287908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:33:20.287908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:33:20.287908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:33:20.287908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:33:20.287908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:33:20.287908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:33:20.287908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8c1229b-9470-4d8f-8451-6fc1e718b652 could not be found. Sep 20 22:33:20.287908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:33:20.289357 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-cee3c95c-86a6-408c-b2a1-35ca228fe67c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Returning 404 to user: Instance f8c1229b-9470-4d8f-8451-6fc1e718b652 could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:33:20.289357 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-cee3c95c-86a6-408c-b2a1-35ca228fe67c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652" status: 404 len: 111 microversion: 2.1 time: 0.030030 Sep 20 22:33:20.289357 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 484/991] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:20 2022] GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:33:20.293766 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-ccc8b5f2-1757-4568-a6f0-9e975d00bcdb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '.version_select at 0x7f24f6767280>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:20.314383 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-ccc8b5f2-1757-4568-a6f0-9e975d00bcdb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208006715" status: 202 len: 0 microversion: 2.1 time: 0.024332 Sep 20 22:33:20.314930 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 508/992] 10.222.0.16 () {58 vars in 1218 bytes} [Tue Sep 20 22:33:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208006715 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:33:20.953088 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-579b5611-b4d1-4245-947b-097eb7e6f9ac tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:20.953591 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-579b5611-b4d1-4245-947b-097eb7e6f9ac tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:20.959628 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-579b5611-b4d1-4245-947b-097eb7e6f9ac tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:20.960118 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-579b5611-b4d1-4245-947b-097eb7e6f9ac tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:20.960558 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-579b5611-b4d1-4245-947b-097eb7e6f9ac tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:20.961288 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-579b5611-b4d1-4245-947b-097eb7e6f9ac tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:20.961791 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-579b5611-b4d1-4245-947b-097eb7e6f9ac tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:20.962218 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-579b5611-b4d1-4245-947b-097eb7e6f9ac tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:21.045055 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-579b5611-b4d1-4245-947b-097eb7e6f9ac tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lazy-loading 'services' on Instance uuid ef067608-a015-4521-8a76-e5aeba165960 {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:33:21.115038 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-579b5611-b4d1-4245-947b-097eb7e6f9ac tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960/os-volume_attachments/feed8368-3333-49ea-a8a8-eceb1d7cd5d2" status: 202 len: 0 microversion: 2.1 time: 0.165797 Sep 20 22:33:21.115616 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 485/993] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 20 22:33:20 2022] DELETE /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960/os-volume_attachments/feed8368-3333-49ea-a8a8-eceb1d7cd5d2 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:33:21.125070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c6108b11-6b33-43cd-baa5-07331653652f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:21.127433 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-c6108b11-6b33-43cd-baa5-07331653652f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:21.134795 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c6108b11-6b33-43cd-baa5-07331653652f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:21.135274 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c6108b11-6b33-43cd-baa5-07331653652f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:21.135885 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c6108b11-6b33-43cd-baa5-07331653652f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:21.136579 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c6108b11-6b33-43cd-baa5-07331653652f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:21.137056 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c6108b11-6b33-43cd-baa5-07331653652f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:21.137477 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c6108b11-6b33-43cd-baa5-07331653652f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:21.174315 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c6108b11-6b33-43cd-baa5-07331653652f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048609 Sep 20 22:33:21.174315 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 509/994] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:33:21 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:33:22.183253 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a8f579c4-42e3-469e-af74-46399bc237fa tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:22.185537 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a8f579c4-42e3-469e-af74-46399bc237fa tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:22.191617 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a8f579c4-42e3-469e-af74-46399bc237fa tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:22.192102 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a8f579c4-42e3-469e-af74-46399bc237fa tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:22.192534 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a8f579c4-42e3-469e-af74-46399bc237fa tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:22.193250 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a8f579c4-42e3-469e-af74-46399bc237fa tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:22.193703 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a8f579c4-42e3-469e-af74-46399bc237fa tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:22.194130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a8f579c4-42e3-469e-af74-46399bc237fa tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:22.222528 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a8f579c4-42e3-469e-af74-46399bc237fa tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044154 Sep 20 22:33:22.223075 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 486/995] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:33:22 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 20 22:33:22.285129 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-1e6f7883-4051-402e-bd20-f25a50f3f4a2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:22.285608 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-1e6f7883-4051-402e-bd20-f25a50f3f4a2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:22.291837 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1e6f7883-4051-402e-bd20-f25a50f3f4a2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:22.292316 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1e6f7883-4051-402e-bd20-f25a50f3f4a2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:22.292741 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1e6f7883-4051-402e-bd20-f25a50f3f4a2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:22.293453 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1e6f7883-4051-402e-bd20-f25a50f3f4a2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:22.293903 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1e6f7883-4051-402e-bd20-f25a50f3f4a2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:22.294946 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1e6f7883-4051-402e-bd20-f25a50f3f4a2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:22.318952 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-1e6f7883-4051-402e-bd20-f25a50f3f4a2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Going to try to terminate instance {{(pid=120474) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:33:22.392552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-1e6f7883-4051-402e-bd20-f25a50f3f4a2 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960" status: 204 len: 0 microversion: 2.1 time: 0.110963 Sep 20 22:33:22.393160 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 510/996] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:33:22 2022] DELETE /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:33:22.401358 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-357dd086-dc3a-4324-80f8-334e122bdd6c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:22.401970 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-357dd086-dc3a-4324-80f8-334e122bdd6c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:22.407824 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-357dd086-dc3a-4324-80f8-334e122bdd6c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:22.408307 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-357dd086-dc3a-4324-80f8-334e122bdd6c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:22.408739 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-357dd086-dc3a-4324-80f8-334e122bdd6c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:22.409458 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-357dd086-dc3a-4324-80f8-334e122bdd6c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:22.409907 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-357dd086-dc3a-4324-80f8-334e122bdd6c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:22.410329 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-357dd086-dc3a-4324-80f8-334e122bdd6c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:22.536200 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-357dd086-dc3a-4324-80f8-334e122bdd6c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:33:22.543907 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-357dd086-dc3a-4324-80f8-334e122bdd6c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960" status: 200 len: 1683 microversion: 2.1 time: 0.146448 Sep 20 22:33:22.545032 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 487/997] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:22 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:33:23.568806 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9ca40bc6-74fa-4471-a669-8ac12d065ec7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:23.569524 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9ca40bc6-74fa-4471-a669-8ac12d065ec7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:23.575781 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9ca40bc6-74fa-4471-a669-8ac12d065ec7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:23.576260 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9ca40bc6-74fa-4471-a669-8ac12d065ec7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:23.577234 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9ca40bc6-74fa-4471-a669-8ac12d065ec7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:23.577912 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9ca40bc6-74fa-4471-a669-8ac12d065ec7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:23.578356 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9ca40bc6-74fa-4471-a669-8ac12d065ec7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:23.578772 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9ca40bc6-74fa-4471-a669-8ac12d065ec7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:23.711342 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-9ca40bc6-74fa-4471-a669-8ac12d065ec7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:33:23.719037 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-9ca40bc6-74fa-4471-a669-8ac12d065ec7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960" status: 200 len: 1683 microversion: 2.1 time: 0.154490 Sep 20 22:33:23.719602 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 511/998] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:23 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:33:24.742428 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a4f70c4e-9ee1-4213-9d54-0aadc8a9ed93 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:24.743763 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a4f70c4e-9ee1-4213-9d54-0aadc8a9ed93 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:24.751693 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a4f70c4e-9ee1-4213-9d54-0aadc8a9ed93 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:24.752183 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a4f70c4e-9ee1-4213-9d54-0aadc8a9ed93 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:24.752622 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a4f70c4e-9ee1-4213-9d54-0aadc8a9ed93 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:24.753403 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a4f70c4e-9ee1-4213-9d54-0aadc8a9ed93 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:24.754092 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a4f70c4e-9ee1-4213-9d54-0aadc8a9ed93 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:24.754488 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-942c2b27-ad52-4494-bdb2-f754c6e20695 req-17d7e54a-fb2c-4d69-9745-7316e77f2d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef067608-a015-4521-8a76-e5aeba165960", "name": "network-vif-deleted", "tag": "3c925cd1-3b42-4284-9099-5cce9585f55e"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:33:24.754960 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a4f70c4e-9ee1-4213-9d54-0aadc8a9ed93 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:24.767814 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-942c2b27-ad52-4494-bdb2-f754c6e20695 req-17d7e54a-fb2c-4d69-9745-7316e77f2d70 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:24.769070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-942c2b27-ad52-4494-bdb2-f754c6e20695 req-17d7e54a-fb2c-4d69-9745-7316e77f2d70 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:24.769586 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-942c2b27-ad52-4494-bdb2-f754c6e20695 req-17d7e54a-fb2c-4d69-9745-7316e77f2d70 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:24.782342 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-942c2b27-ad52-4494-bdb2-f754c6e20695 req-17d7e54a-fb2c-4d69-9745-7316e77f2d70 service nova] Creating event network-vif-deleted:3c925cd1-3b42-4284-9099-5cce9585f55e for instance ef067608-a015-4521-8a76-e5aeba165960 on hv-cinder-85827 Sep 20 22:33:24.788066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-942c2b27-ad52-4494-bdb2-f754c6e20695 req-17d7e54a-fb2c-4d69-9745-7316e77f2d70 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039119 Sep 20 22:33:24.789149 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 512/999] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:33:24.849412 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a4f70c4e-9ee1-4213-9d54-0aadc8a9ed93 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:33:24.858794 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a4f70c4e-9ee1-4213-9d54-0aadc8a9ed93 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960" status: 200 len: 1615 microversion: 2.1 time: 0.119654 Sep 20 22:33:24.859631 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 488/1000] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:24 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 => generated 1615 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:33:25.883892 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-39e73b67-9f65-4190-afa8-59a1f21b7405 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:25.884731 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-39e73b67-9f65-4190-afa8-59a1f21b7405 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:25.891411 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-39e73b67-9f65-4190-afa8-59a1f21b7405 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:25.891896 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-39e73b67-9f65-4190-afa8-59a1f21b7405 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:25.892328 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-39e73b67-9f65-4190-afa8-59a1f21b7405 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:25.893041 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-39e73b67-9f65-4190-afa8-59a1f21b7405 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:25.893497 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-39e73b67-9f65-4190-afa8-59a1f21b7405 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:25.893922 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-39e73b67-9f65-4190-afa8-59a1f21b7405 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:25.907157 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-39e73b67-9f65-4190-afa8-59a1f21b7405 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] HTTP exception thrown: Instance ef067608-a015-4521-8a76-e5aeba165960 could not be found. Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-39e73b67-9f65-4190-afa8-59a1f21b7405 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Request method failure captured: Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 HTTP/1.1 Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj9Aeyxjf5yMqHjDnCvmmvzhWQGzCrsBQuX_13kvowH7Ss-qoNBJb-Gfzs2nh_Wxq8YsnyXcveK6Mf9KXU9rYT6WvCgM2KCRhWvNuoaiFUsmz4N6dsiGMTW1t41Prgmfndkff0JZfffcZEBsySI2HYoAQ7I1a7TgST0Ce1eGA0Ik8Kw Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:33:25.908733 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:33:25.910324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59af02f2b4984c6190870041aa020d75", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59af02f2b4984c6190870041aa020d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:33:25.910324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:33:25.910324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:33:25.910324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:33:25.910324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:33:25.910324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:33:25.910324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:33:25.910324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 4af67f949fda43bf8967925f04491bd8 Sep 20 22:33:25.910324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:33:25.910324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:33:25.910324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance ef067608-a015-4521-8a76-e5aeba165960 could not be found. Sep 20 22:33:25.910324 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': 'ef067608-a015-4521-8a76-e5aeba165960'} Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef067608-a015-4521-8a76-e5aeba165960 could not be found. Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:33:25.911186 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:33:25.912415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:33:25.912415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:33:25.912415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:33:25.912415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:33:25.912415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:33:25.912415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:33:25.912415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:33:25.912415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef067608-a015-4521-8a76-e5aeba165960 could not be found. Sep 20 22:33:25.912415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:33:25.912415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:33:25.912415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:33:25.912415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:33:25.912415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:33:25.912415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:33:25.912415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:33:25.912415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:33:25.912415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef067608-a015-4521-8a76-e5aeba165960 could not be found. Sep 20 22:33:25.912415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:33:25.913564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-39e73b67-9f65-4190-afa8-59a1f21b7405 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Returning 404 to user: Instance ef067608-a015-4521-8a76-e5aeba165960 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:33:25.913564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-39e73b67-9f65-4190-afa8-59a1f21b7405 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960" status: 404 len: 111 microversion: 2.1 time: 0.030771 Sep 20 22:33:25.913564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 513/1001] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:25 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:33:25.918800 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-17848463-d442-4d24-89d8-27bf9c9c8ba0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '.version_select at 0x7f24f679c310>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:25.937045 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-17848463-d442-4d24-89d8-27bf9c9c8ba0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585712580" status: 202 len: 0 microversion: 2.1 time: 0.022038 Sep 20 22:33:25.937583 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 489/1002] 10.222.0.16 () {58 vars in 1221 bytes} [Tue Sep 20 22:33:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585712580 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:33:26.533415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5375eb1f-480f-469c-84f8-98afeeaf2e27 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Action: 'create', calling method: .version_select at 0x7f24f6992670>, body: {"keypair": {"name": "tempest-keypair-1580183203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItiFM5d9dZGlr2PfFCUEjpO30fyWWeoJOd5nyDorTk4QF4GZr8AEUxBoXy+P9laO6+J89fojr5z+jOPK4ArWtVlH1AS1YkpJawRmT9/WWvhgE3oAOvJDaNnWUB6BymlhA=="}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:33:26.548399 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-5375eb1f-480f-469c-84f8-98afeeaf2e27 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Getting quotas for project 59af02f2b4984c6190870041aa020d75. Resources: {'key_pairs'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:33:26.552175 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-5375eb1f-480f-469c-84f8-98afeeaf2e27 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Getting quotas for user 4af67f949fda43bf8967925f04491bd8 and project 59af02f2b4984c6190870041aa020d75. Resources: {'key_pairs'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:33:26.573199 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5375eb1f-480f-469c-84f8-98afeeaf2e27 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044423 Sep 20 22:33:26.573774 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 514/1003] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 20 22:33:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:33:27.826841 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8cfb1ff0-ea21-4fc4-afd0-cd51d3dec6a3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-252463592", "imageRef": "a1be001e-c2e4-44b7-b0d2-af96de3855c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fdd6da27-ff07-48de-8020-aad44ec6dade"}], "security_groups": [{"name": "tempest-securitygroup--1787770658"}], "key_name": "tempest-keypair-1580183203", "user_data": "}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:33:27.926792 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.network.neutron [None req-8cfb1ff0-ea21-4fc4-afd0-cd51d3dec6a3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] validate_networks() for [('fdd6da27-ff07-48de-8020-aad44ec6dade', None, None, None, None, None)] {{(pid=120473) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:33:28.278496 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-8cfb1ff0-ea21-4fc4-afd0-cd51d3dec6a3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Flavor limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:33:28.278914 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-8cfb1ff0-ea21-4fc4-afd0-cd51d3dec6a3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Image limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:33:28.279384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-8cfb1ff0-ea21-4fc4-afd0-cd51d3dec6a3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Flavor pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:33:28.280304 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-8cfb1ff0-ea21-4fc4-afd0-cd51d3dec6a3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Image pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:33:28.280714 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-8cfb1ff0-ea21-4fc4-afd0-cd51d3dec6a3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:33:28.289353 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8cfb1ff0-ea21-4fc4-afd0-cd51d3dec6a3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:28.289831 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8cfb1ff0-ea21-4fc4-afd0-cd51d3dec6a3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:28.290260 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8cfb1ff0-ea21-4fc4-afd0-cd51d3dec6a3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:28.290971 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8cfb1ff0-ea21-4fc4-afd0-cd51d3dec6a3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:28.291417 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8cfb1ff0-ea21-4fc4-afd0-cd51d3dec6a3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:28.291831 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8cfb1ff0-ea21-4fc4-afd0-cd51d3dec6a3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:28.308874 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-8cfb1ff0-ea21-4fc4-afd0-cd51d3dec6a3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Getting quotas for project 59af02f2b4984c6190870041aa020d75. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:33:28.312733 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-8cfb1ff0-ea21-4fc4-afd0-cd51d3dec6a3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Getting quotas for user 4af67f949fda43bf8967925f04491bd8 and project 59af02f2b4984c6190870041aa020d75. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:33:28.323325 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8cfb1ff0-ea21-4fc4-afd0-cd51d3dec6a3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Going to run 1 instances... {{(pid=120473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:33:28.325712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8cfb1ff0-ea21-4fc4-afd0-cd51d3dec6a3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a1be001e-c2e4-44b7-b0d2-af96de3855c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:33:28.373795 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-8cfb1ff0-ea21-4fc4-afd0-cd51d3dec6a3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.551809 Sep 20 22:33:28.374438 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 490/1004] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:33:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 22:33:28.386512 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f51a7465-8d64-4025-81c5-e42c059ec605 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:28.387377 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-f51a7465-8d64-4025-81c5-e42c059ec605 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:28.446692 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-f51a7465-8d64-4025-81c5-e42c059ec605 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:33:28.454354 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-f51a7465-8d64-4025-81c5-e42c059ec605 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971" status: 200 len: 1241 microversion: 2.1 time: 0.071730 Sep 20 22:33:28.454806 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 515/1005] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:28 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:33:29.477600 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-52dcf587-857f-4bba-9091-bf750a627eb4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:29.478753 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-52dcf587-857f-4bba-9091-bf750a627eb4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:29.485621 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-52dcf587-857f-4bba-9091-bf750a627eb4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:29.486346 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-52dcf587-857f-4bba-9091-bf750a627eb4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:29.486968 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-52dcf587-857f-4bba-9091-bf750a627eb4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:29.487871 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-52dcf587-857f-4bba-9091-bf750a627eb4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:29.488512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-52dcf587-857f-4bba-9091-bf750a627eb4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:29.489273 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-52dcf587-857f-4bba-9091-bf750a627eb4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:29.550975 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-52dcf587-857f-4bba-9091-bf750a627eb4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:33:29.558462 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-52dcf587-857f-4bba-9091-bf750a627eb4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971" status: 200 len: 1299 microversion: 2.1 time: 0.085467 Sep 20 22:33:29.559025 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 491/1006] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:29 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:33:30.582926 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-7aff94c9-3632-497d-b357-5cc6f4ebc5fb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:30.583538 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-7aff94c9-3632-497d-b357-5cc6f4ebc5fb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:30.589932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7aff94c9-3632-497d-b357-5cc6f4ebc5fb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:30.590414 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7aff94c9-3632-497d-b357-5cc6f4ebc5fb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:30.590846 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7aff94c9-3632-497d-b357-5cc6f4ebc5fb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:30.591539 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7aff94c9-3632-497d-b357-5cc6f4ebc5fb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:30.591995 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7aff94c9-3632-497d-b357-5cc6f4ebc5fb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:30.592417 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-7aff94c9-3632-497d-b357-5cc6f4ebc5fb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:30.722030 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-7aff94c9-3632-497d-b357-5cc6f4ebc5fb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:33:30.729503 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-7aff94c9-3632-497d-b357-5cc6f4ebc5fb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971" status: 200 len: 1367 microversion: 2.1 time: 0.150410 Sep 20 22:33:30.730073 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 516/1007] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:30 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:33:30.778890 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-72b45512-a80d-441c-bd97-07c777bcff51 req-b0e4ddbe-25c1-4a83-b23e-2bda575c1826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2abce7e-ea74-4d2b-8d44-2e7889fe8971", "tag": "00e67254-d3c8-4610-91f0-b807532d876b"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:33:30.792734 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-72b45512-a80d-441c-bd97-07c777bcff51 req-b0e4ddbe-25c1-4a83-b23e-2bda575c1826 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:30.793261 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-72b45512-a80d-441c-bd97-07c777bcff51 req-b0e4ddbe-25c1-4a83-b23e-2bda575c1826 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:30.793840 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-72b45512-a80d-441c-bd97-07c777bcff51 req-b0e4ddbe-25c1-4a83-b23e-2bda575c1826 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:30.807130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-72b45512-a80d-441c-bd97-07c777bcff51 req-b0e4ddbe-25c1-4a83-b23e-2bda575c1826 service nova] Creating event network-changed:00e67254-d3c8-4610-91f0-b807532d876b for instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 on hv-cinder-85827 Sep 20 22:33:30.812889 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-72b45512-a80d-441c-bd97-07c777bcff51 req-b0e4ddbe-25c1-4a83-b23e-2bda575c1826 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039710 Sep 20 22:33:30.813799 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 492/1008] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:33:31.754351 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-60136563-3988-4557-91ac-d8c1819df641 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:31.754961 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-60136563-3988-4557-91ac-d8c1819df641 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:31.761412 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-60136563-3988-4557-91ac-d8c1819df641 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:31.761900 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-60136563-3988-4557-91ac-d8c1819df641 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:31.762333 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-60136563-3988-4557-91ac-d8c1819df641 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:31.763020 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-60136563-3988-4557-91ac-d8c1819df641 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:31.763472 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-60136563-3988-4557-91ac-d8c1819df641 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:31.763894 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-60136563-3988-4557-91ac-d8c1819df641 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:31.887380 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-60136563-3988-4557-91ac-d8c1819df641 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:33:31.895403 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-60136563-3988-4557-91ac-d8c1819df641 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971" status: 200 len: 1367 microversion: 2.1 time: 0.144926 Sep 20 22:33:31.895965 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 517/1009] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:31 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:33:32.919080 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a8f6a144-2e5c-4ffc-9980-cb8080b51acc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:32.919793 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a8f6a144-2e5c-4ffc-9980-cb8080b51acc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:32.927086 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a8f6a144-2e5c-4ffc-9980-cb8080b51acc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:32.927574 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a8f6a144-2e5c-4ffc-9980-cb8080b51acc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:32.928016 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a8f6a144-2e5c-4ffc-9980-cb8080b51acc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:32.928713 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a8f6a144-2e5c-4ffc-9980-cb8080b51acc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:32.929203 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a8f6a144-2e5c-4ffc-9980-cb8080b51acc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:32.929636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a8f6a144-2e5c-4ffc-9980-cb8080b51acc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:33.057542 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a8f6a144-2e5c-4ffc-9980-cb8080b51acc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:33:33.065658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a8f6a144-2e5c-4ffc-9980-cb8080b51acc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971" status: 200 len: 1367 microversion: 2.1 time: 0.150833 Sep 20 22:33:33.066248 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 493/1010] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:32 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:33:34.087637 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3780f7c8-fb38-4d42-a728-62e02e083d08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:34.088282 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-3780f7c8-fb38-4d42-a728-62e02e083d08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:34.095236 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3780f7c8-fb38-4d42-a728-62e02e083d08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:34.095714 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3780f7c8-fb38-4d42-a728-62e02e083d08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:34.096147 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3780f7c8-fb38-4d42-a728-62e02e083d08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:34.096833 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3780f7c8-fb38-4d42-a728-62e02e083d08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:34.097325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3780f7c8-fb38-4d42-a728-62e02e083d08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:34.097778 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3780f7c8-fb38-4d42-a728-62e02e083d08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:34.225486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-3780f7c8-fb38-4d42-a728-62e02e083d08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:33:34.233614 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-3780f7c8-fb38-4d42-a728-62e02e083d08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971" status: 200 len: 1367 microversion: 2.1 time: 0.149272 Sep 20 22:33:34.234176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 518/1011] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:34 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:33:35.256931 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-07404d12-9102-412f-80ac-4eff8594a2eb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:35.257567 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-07404d12-9102-412f-80ac-4eff8594a2eb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:35.263844 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-07404d12-9102-412f-80ac-4eff8594a2eb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:35.264331 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-07404d12-9102-412f-80ac-4eff8594a2eb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:35.264821 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-07404d12-9102-412f-80ac-4eff8594a2eb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:35.266055 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-07404d12-9102-412f-80ac-4eff8594a2eb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:35.266553 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-07404d12-9102-412f-80ac-4eff8594a2eb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:35.266975 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-07404d12-9102-412f-80ac-4eff8594a2eb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:35.588365 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-07404d12-9102-412f-80ac-4eff8594a2eb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:33:35.598801 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-07404d12-9102-412f-80ac-4eff8594a2eb tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971" status: 200 len: 1367 microversion: 2.1 time: 0.345684 Sep 20 22:33:35.599530 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 494/1012] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:35 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:33:36.623201 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-524f4b98-7981-422b-b97f-411f1b407039 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:36.623756 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-524f4b98-7981-422b-b97f-411f1b407039 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:36.630696 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-524f4b98-7981-422b-b97f-411f1b407039 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:36.631172 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-524f4b98-7981-422b-b97f-411f1b407039 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:36.631602 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-524f4b98-7981-422b-b97f-411f1b407039 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:36.632281 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-524f4b98-7981-422b-b97f-411f1b407039 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:36.632734 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-524f4b98-7981-422b-b97f-411f1b407039 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:36.633184 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-524f4b98-7981-422b-b97f-411f1b407039 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:36.813222 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-524f4b98-7981-422b-b97f-411f1b407039 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:33:36.820711 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-524f4b98-7981-422b-b97f-411f1b407039 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971" status: 200 len: 1367 microversion: 2.1 time: 0.201813 Sep 20 22:33:36.821300 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 519/1013] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:36 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:33:37.564348 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-b3f8405a-11fc-4fe3-82a0-267d911f0064 req-b370de67-dae9-41bd-8f51-96d784175215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2abce7e-ea74-4d2b-8d44-2e7889fe8971", "name": "network-vif-plugged", "status": "completed", "tag": "00e67254-d3c8-4610-91f0-b807532d876b"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:33:37.574881 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-b3f8405a-11fc-4fe3-82a0-267d911f0064 req-b370de67-dae9-41bd-8f51-96d784175215 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:37.575934 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-b3f8405a-11fc-4fe3-82a0-267d911f0064 req-b370de67-dae9-41bd-8f51-96d784175215 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:37.576375 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-b3f8405a-11fc-4fe3-82a0-267d911f0064 req-b370de67-dae9-41bd-8f51-96d784175215 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:37.588918 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-b3f8405a-11fc-4fe3-82a0-267d911f0064 req-b370de67-dae9-41bd-8f51-96d784175215 service nova] Creating event network-vif-plugged:00e67254-d3c8-4610-91f0-b807532d876b for instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 on hv-cinder-85827 Sep 20 22:33:37.596187 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-b3f8405a-11fc-4fe3-82a0-267d911f0064 req-b370de67-dae9-41bd-8f51-96d784175215 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034024 Sep 20 22:33:37.597039 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 495/1014] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:33:37.843444 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5b473475-3993-490c-ac97-2b10d26a3716 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:37.844049 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5b473475-3993-490c-ac97-2b10d26a3716 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:37.850336 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5b473475-3993-490c-ac97-2b10d26a3716 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:37.850816 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5b473475-3993-490c-ac97-2b10d26a3716 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:37.851242 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5b473475-3993-490c-ac97-2b10d26a3716 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:37.851924 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5b473475-3993-490c-ac97-2b10d26a3716 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:37.852376 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5b473475-3993-490c-ac97-2b10d26a3716 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:37.852788 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5b473475-3993-490c-ac97-2b10d26a3716 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:37.984070 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-5b473475-3993-490c-ac97-2b10d26a3716 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:33:37.992423 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5b473475-3993-490c-ac97-2b10d26a3716 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971" status: 200 len: 1367 microversion: 2.1 time: 0.152804 Sep 20 22:33:37.993001 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 520/1015] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:37 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:33:39.015698 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-403e9eb9-5662-42c9-9a57-cd572c1eb93a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:39.016412 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-403e9eb9-5662-42c9-9a57-cd572c1eb93a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:39.018359 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=2 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:39.019015 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=6 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:39.025930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-403e9eb9-5662-42c9-9a57-cd572c1eb93a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:39.025930 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-403e9eb9-5662-42c9-9a57-cd572c1eb93a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:39.026183 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-403e9eb9-5662-42c9-9a57-cd572c1eb93a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:39.026880 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-403e9eb9-5662-42c9-9a57-cd572c1eb93a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:39.027335 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-403e9eb9-5662-42c9-9a57-cd572c1eb93a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:39.027760 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-403e9eb9-5662-42c9-9a57-cd572c1eb93a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:39.157682 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-403e9eb9-5662-42c9-9a57-cd572c1eb93a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:33:39.165422 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-403e9eb9-5662-42c9-9a57-cd572c1eb93a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971" status: 200 len: 1557 microversion: 2.1 time: 0.153910 Sep 20 22:33:39.165983 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 496/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:33:39 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:33:39.187885 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9939bcd0-aaa6-4b7c-9f2e-9d9eecea8989 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:33:39.189041 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9939bcd0-aaa6-4b7c-9f2e-9d9eecea8989 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:33:39.191040 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=6 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:39.196524 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9939bcd0-aaa6-4b7c-9f2e-9d9eecea8989 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:39.197018 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9939bcd0-aaa6-4b7c-9f2e-9d9eecea8989 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:39.197450 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9939bcd0-aaa6-4b7c-9f2e-9d9eecea8989 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:39.198133 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9939bcd0-aaa6-4b7c-9f2e-9d9eecea8989 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:39.198576 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9939bcd0-aaa6-4b7c-9f2e-9d9eecea8989 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:39.198996 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9939bcd0-aaa6-4b7c-9f2e-9d9eecea8989 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:39.214759 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:39.276239 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-9939bcd0-aaa6-4b7c-9f2e-9d9eecea8989 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092113 Sep 20 22:33:39.276838 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 521/1017] 10.222.0.16 () {58 vars in 1275 bytes} [Tue Sep 20 22:33:39 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:33:40.420595 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-88eceeb1-e8d2-4cc6-9daa-651f0aab2461 req-e66d0a53-c976-411a-b42e-ba3be5e882d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2abce7e-ea74-4d2b-8d44-2e7889fe8971", "tag": "00e67254-d3c8-4610-91f0-b807532d876b"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:33:40.430859 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-88eceeb1-e8d2-4cc6-9daa-651f0aab2461 req-e66d0a53-c976-411a-b42e-ba3be5e882d4 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:33:40.431861 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-88eceeb1-e8d2-4cc6-9daa-651f0aab2461 req-e66d0a53-c976-411a-b42e-ba3be5e882d4 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:33:40.432136 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-88eceeb1-e8d2-4cc6-9daa-651f0aab2461 req-e66d0a53-c976-411a-b42e-ba3be5e882d4 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:33:40.443560 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-88eceeb1-e8d2-4cc6-9daa-651f0aab2461 req-e66d0a53-c976-411a-b42e-ba3be5e882d4 service nova] Creating event network-changed:00e67254-d3c8-4610-91f0-b807532d876b for instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 on hv-cinder-85827 Sep 20 22:33:40.448464 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-88eceeb1-e8d2-4cc6-9daa-651f0aab2461 req-e66d0a53-c976-411a-b42e-ba3be5e882d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031561 Sep 20 22:33:40.449264 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 497/1018] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:34:15.350391 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:15.351755 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 20 22:34:15.352141 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Tue Sep 20 22:34:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971/ips (ip 10.222.0.16) !!! Sep 20 22:34:15.356620 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-aa2e8cc1-5078-4ce7-990e-f08a32c7a51a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:15.357144 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-aa2e8cc1-5078-4ce7-990e-f08a32c7a51a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:15.366297 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-aa2e8cc1-5078-4ce7-990e-f08a32c7a51a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:15.366813 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-aa2e8cc1-5078-4ce7-990e-f08a32c7a51a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:15.367246 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-aa2e8cc1-5078-4ce7-990e-f08a32c7a51a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:15.367935 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-aa2e8cc1-5078-4ce7-990e-f08a32c7a51a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:15.368389 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-aa2e8cc1-5078-4ce7-990e-f08a32c7a51a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:15.368809 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-aa2e8cc1-5078-4ce7-990e-f08a32c7a51a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:15.395381 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-aa2e8cc1-5078-4ce7-990e-f08a32c7a51a tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971/ips" status: 200 len: 150 microversion: 2.1 time: 0.046425 Sep 20 22:34:15.395985 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 522/1019] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 20 22:34:15 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:34:16.728014 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d460f744-831b-4b20-9c99-fa56f401423e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f86821b6-f3fe-44e8-9ab4-64dc6ccdb615"}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:34:16.730506 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d460f744-831b-4b20-9c99-fa56f401423e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:16.732896 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:16.733555 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:16.740599 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d460f744-831b-4b20-9c99-fa56f401423e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:16.741106 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d460f744-831b-4b20-9c99-fa56f401423e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:16.741540 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d460f744-831b-4b20-9c99-fa56f401423e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:16.742251 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d460f744-831b-4b20-9c99-fa56f401423e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:16.742699 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d460f744-831b-4b20-9c99-fa56f401423e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:16.743118 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d460f744-831b-4b20-9c99-fa56f401423e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:16.983094 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-d460f744-831b-4b20-9c99-fa56f401423e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "POST /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259114 Sep 20 22:34:16.983614 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 498/1020] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 20 22:34:16 2022] POST /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:34:23.469888 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-19f0633f-2ece-47d0-aacf-e8d9b4621245 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f86821b6-f3fe-44e8-9ab4-64dc6ccdb615"}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:34:23.473058 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-19f0633f-2ece-47d0-aacf-e8d9b4621245 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:23.480084 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-19f0633f-2ece-47d0-aacf-e8d9b4621245 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:23.480580 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-19f0633f-2ece-47d0-aacf-e8d9b4621245 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:23.481040 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-19f0633f-2ece-47d0-aacf-e8d9b4621245 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:23.481745 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-19f0633f-2ece-47d0-aacf-e8d9b4621245 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:23.482200 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-19f0633f-2ece-47d0-aacf-e8d9b4621245 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:23.482623 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-19f0633f-2ece-47d0-aacf-e8d9b4621245 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:23.562727 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-19f0633f-2ece-47d0-aacf-e8d9b4621245 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] HTTP exception thrown: Invalid volume: volume f86821b6-f3fe-44e8-9ab4-64dc6ccdb615 is already attached to instances: b2abce7e-ea74-4d2b-8d44-2e7889fe8971 Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-19f0633f-2ece-47d0-aacf-e8d9b4621245 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Request method failure captured: Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: POST /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971/os-volume_attachments HTTP/1.1 Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 74 Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj9Aeyxjf5yMqHjDnCvmmvzhWQGzCrsBQuX_13kvowH7Ss-qoNBJb-Gfzs2nh_Wxq8YsnyXcveK6Mf9KXU9rYT6WvCgM2KCRhWvNuoaiFUsmz4N6dsiGMTW1t41Prgmfndkff0JZfffcZEBsySI2HYoAQ7I1a7TgST0Ce1eGA0Ik8Kw Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:34:23.565008 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:34:23.566672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59af02f2b4984c6190870041aa020d75", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59af02f2b4984c6190870041aa020d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:34:23.566672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:34:23.566672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:34:23.566672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:34:23.566672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:34:23.566672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:34:23.566672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:34:23.566672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 4af67f949fda43bf8967925f04491bd8 Sep 20 22:34:23.566672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:34:23.566672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Sep 20 22:34:23.566672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {"volumeAttachment": {"volumeId": "f86821b6-f3fe-44e8-9ab4-64dc6ccdb615"}} Sep 20 22:34:23.566672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Invalid volume: volume f86821b6-f3fe-44e8-9ab4-64dc6ccdb615 is already attached to instances: b2abce7e-ea74-4d2b-8d44-2e7889fe8971 Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'server_id': 'b2abce7e-ea74-4d2b-8d44-2e7889fe8971', 'body': {'volumeAttachment': {'volumeId': 'f86821b6-f3fe-44e8-9ab4-64dc6ccdb615'}}} Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f86821b6-f3fe-44e8-9ab4-64dc6ccdb615 is already attached to instances: b2abce7e-ea74-4d2b-8d44-2e7889fe8971 Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:34:23.567603 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f86821b6-f3fe-44e8-9ab4-64dc6ccdb615 is already attached to instances: b2abce7e-ea74-4d2b-8d44-2e7889fe8971 Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:34:23.569087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:34:23.570634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:34:23.570634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:34:23.570634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:34:23.570634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f86821b6-f3fe-44e8-9ab4-64dc6ccdb615 is already attached to instances: b2abce7e-ea74-4d2b-8d44-2e7889fe8971 Sep 20 22:34:23.570634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:34:23.570634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-19f0633f-2ece-47d0-aacf-e8d9b4621245 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Returning 400 to user: Invalid volume: volume f86821b6-f3fe-44e8-9ab4-64dc6ccdb615 is already attached to instances: b2abce7e-ea74-4d2b-8d44-2e7889fe8971 {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:34:23.570634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-19f0633f-2ece-47d0-aacf-e8d9b4621245 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "POST /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100637 Sep 20 22:34:23.570634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 523/1021] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 20 22:34:23 2022] POST /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 20 22:34:23.634215 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-e0628f50-ad17-432e-82f5-b3ff466b7fc8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:23.634799 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-e0628f50-ad17-432e-82f5-b3ff466b7fc8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:23.641107 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e0628f50-ad17-432e-82f5-b3ff466b7fc8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:23.641596 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e0628f50-ad17-432e-82f5-b3ff466b7fc8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:23.642030 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e0628f50-ad17-432e-82f5-b3ff466b7fc8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:23.643313 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e0628f50-ad17-432e-82f5-b3ff466b7fc8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:23.643766 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e0628f50-ad17-432e-82f5-b3ff466b7fc8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:23.644191 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e0628f50-ad17-432e-82f5-b3ff466b7fc8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:23.724025 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-e0628f50-ad17-432e-82f5-b3ff466b7fc8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lazy-loading 'services' on Instance uuid b2abce7e-ea74-4d2b-8d44-2e7889fe8971 {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:34:23.802144 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-e0628f50-ad17-432e-82f5-b3ff466b7fc8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971/os-volume_attachments/f86821b6-f3fe-44e8-9ab4-64dc6ccdb615" status: 202 len: 0 microversion: 2.1 time: 0.172643 Sep 20 22:34:23.803084 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 499/1022] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 20 22:34:23 2022] DELETE /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971/os-volume_attachments/f86821b6-f3fe-44e8-9ab4-64dc6ccdb615 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:34:23.812073 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-198ec960-dcb7-462b-a705-802fb1f26360 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:23.814890 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-198ec960-dcb7-462b-a705-802fb1f26360 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:23.821892 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-198ec960-dcb7-462b-a705-802fb1f26360 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:23.822375 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-198ec960-dcb7-462b-a705-802fb1f26360 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:23.822831 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-198ec960-dcb7-462b-a705-802fb1f26360 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:23.823543 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-198ec960-dcb7-462b-a705-802fb1f26360 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:23.823995 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-198ec960-dcb7-462b-a705-802fb1f26360 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:23.824417 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-198ec960-dcb7-462b-a705-802fb1f26360 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:23.854341 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-198ec960-dcb7-462b-a705-802fb1f26360 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046249 Sep 20 22:34:23.854862 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 524/1023] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:34:23 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:34:24.867664 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-661be7fc-89aa-412a-9e83-44f852e2a450 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:24.870221 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-661be7fc-89aa-412a-9e83-44f852e2a450 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:24.876775 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-661be7fc-89aa-412a-9e83-44f852e2a450 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:24.877295 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-661be7fc-89aa-412a-9e83-44f852e2a450 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:24.877767 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-661be7fc-89aa-412a-9e83-44f852e2a450 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:24.878472 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-661be7fc-89aa-412a-9e83-44f852e2a450 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:24.878925 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-661be7fc-89aa-412a-9e83-44f852e2a450 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:24.879349 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-661be7fc-89aa-412a-9e83-44f852e2a450 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:24.911212 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-661be7fc-89aa-412a-9e83-44f852e2a450 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047999 Sep 20 22:34:24.911765 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 500/1024] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:34:24 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:34:25.746885 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-4ce76fa1-fdd2-49bd-b5f6-f13d490aec19 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-749496666", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-262726890", "security_groups": [{"name": "tempest-secgroup-smoke-2073120544"}], "block_device_mapping_v2": [{"uuid": "63988345-36d4-4d15-b2a9-c2fab1851e19", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "da8aba85-9a54-4a6e-abea-b06fe770c5b2"}]}} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:34:25.857930 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.network.neutron [None req-4ce76fa1-fdd2-49bd-b5f6-f13d490aec19 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] validate_networks() for [('da8aba85-9a54-4a6e-abea-b06fe770c5b2', None, None, None, None, None)] {{(pid=120474) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:34:25.923809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ea832cfe-1eba-4fd5-9d84-9b554201d7c5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:25.926663 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ea832cfe-1eba-4fd5-9d84-9b554201d7c5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:25.933123 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ea832cfe-1eba-4fd5-9d84-9b554201d7c5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:25.933606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ea832cfe-1eba-4fd5-9d84-9b554201d7c5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:25.934044 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ea832cfe-1eba-4fd5-9d84-9b554201d7c5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:25.934737 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ea832cfe-1eba-4fd5-9d84-9b554201d7c5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:25.935186 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ea832cfe-1eba-4fd5-9d84-9b554201d7c5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:25.935608 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ea832cfe-1eba-4fd5-9d84-9b554201d7c5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:25.964397 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ea832cfe-1eba-4fd5-9d84-9b554201d7c5 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044545 Sep 20 22:34:25.964995 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 501/1025] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:34:25 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 20 22:34:26.031486 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-12c4cb9b-c8c3-4ac8-ab5a-2cdfb5d2fa8e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:26.031988 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-12c4cb9b-c8c3-4ac8-ab5a-2cdfb5d2fa8e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:26.038379 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-12c4cb9b-c8c3-4ac8-ab5a-2cdfb5d2fa8e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:26.038865 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-12c4cb9b-c8c3-4ac8-ab5a-2cdfb5d2fa8e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:26.039519 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-12c4cb9b-c8c3-4ac8-ab5a-2cdfb5d2fa8e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:26.040215 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-12c4cb9b-c8c3-4ac8-ab5a-2cdfb5d2fa8e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:26.040840 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-12c4cb9b-c8c3-4ac8-ab5a-2cdfb5d2fa8e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:26.041322 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-12c4cb9b-c8c3-4ac8-ab5a-2cdfb5d2fa8e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:26.067807 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-12c4cb9b-c8c3-4ac8-ab5a-2cdfb5d2fa8e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Going to try to terminate instance {{(pid=120473) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:34:26.149172 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-12c4cb9b-c8c3-4ac8-ab5a-2cdfb5d2fa8e tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971" status: 204 len: 0 microversion: 2.1 time: 0.120687 Sep 20 22:34:26.150074 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 502/1026] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:34:26 2022] DELETE /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 20 22:34:26.160880 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-e39354fa-0651-4a30-85e4-f0f8855ea13b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:26.161656 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-e39354fa-0651-4a30-85e4-f0f8855ea13b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:26.167591 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e39354fa-0651-4a30-85e4-f0f8855ea13b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:26.168069 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e39354fa-0651-4a30-85e4-f0f8855ea13b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:26.168503 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e39354fa-0651-4a30-85e4-f0f8855ea13b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:26.169268 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e39354fa-0651-4a30-85e4-f0f8855ea13b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:26.169733 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e39354fa-0651-4a30-85e4-f0f8855ea13b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:26.170154 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-e39354fa-0651-4a30-85e4-f0f8855ea13b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:26.246806 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-4ce76fa1-fdd2-49bd-b5f6-f13d490aec19 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Flavor limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:34:26.247225 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-4ce76fa1-fdd2-49bd-b5f6-f13d490aec19 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Image limits 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:34:26.247691 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-4ce76fa1-fdd2-49bd-b5f6-f13d490aec19 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Flavor pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:34:26.248300 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-4ce76fa1-fdd2-49bd-b5f6-f13d490aec19 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Image pref 0:0:0 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:34:26.248512 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.virt.hardware [None req-4ce76fa1-fdd2-49bd-b5f6-f13d490aec19 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:34:26.257457 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4ce76fa1-fdd2-49bd-b5f6-f13d490aec19 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:26.257939 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4ce76fa1-fdd2-49bd-b5f6-f13d490aec19 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:26.258368 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4ce76fa1-fdd2-49bd-b5f6-f13d490aec19 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:26.259112 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4ce76fa1-fdd2-49bd-b5f6-f13d490aec19 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:26.259557 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4ce76fa1-fdd2-49bd-b5f6-f13d490aec19 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:26.259975 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-4ce76fa1-fdd2-49bd-b5f6-f13d490aec19 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:26.276766 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-4ce76fa1-fdd2-49bd-b5f6-f13d490aec19 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Getting quotas for project 42019663de764ee490940ccca9300b0f. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:34:26.280674 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.quota [None req-4ce76fa1-fdd2-49bd-b5f6-f13d490aec19 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Getting quotas for user b1b69806fd5f4885a824a58fa1d4432c and project 42019663de764ee490940ccca9300b0f. Resources: {'ram', 'cores', 'instances'} {{(pid=120474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:34:26.299610 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-e39354fa-0651-4a30-85e4-f0f8855ea13b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:26.307240 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-e39354fa-0651-4a30-85e4-f0f8855ea13b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971" status: 200 len: 1682 microversion: 2.1 time: 0.151266 Sep 20 22:34:26.307889 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 503/1027] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:26 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:26.338790 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4ce76fa1-fdd2-49bd-b5f6-f13d490aec19 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Going to run 1 instances... {{(pid=120474) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:34:26.340956 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-4ce76fa1-fdd2-49bd-b5f6-f13d490aec19 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63988345-36d4-4d15-b2a9-c2fab1851e19',volume_size=None,volume_type=None)] {{(pid=120474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:34:26.468065 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-4ce76fa1-fdd2-49bd-b5f6-f13d490aec19 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.725588 Sep 20 22:34:26.468679 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 525/1028] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:34:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 22:34:26.479838 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-fb87e366-0938-4cec-8fe6-14f0f8adb69b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:26.480734 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-fb87e366-0938-4cec-8fe6-14f0f8adb69b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:26.535018 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-fb87e366-0938-4cec-8fe6-14f0f8adb69b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:26.541915 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-fb87e366-0938-4cec-8fe6-14f0f8adb69b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1093 microversion: 2.1 time: 0.065962 Sep 20 22:34:26.542483 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 504/1029] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:26 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:27.331280 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-367d3ece-0d00-4576-b384-490fdd0fdea7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:27.331932 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-367d3ece-0d00-4576-b384-490fdd0fdea7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:27.338017 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-367d3ece-0d00-4576-b384-490fdd0fdea7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:27.338499 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-367d3ece-0d00-4576-b384-490fdd0fdea7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:27.338937 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-367d3ece-0d00-4576-b384-490fdd0fdea7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:27.339625 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-367d3ece-0d00-4576-b384-490fdd0fdea7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:27.340087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-367d3ece-0d00-4576-b384-490fdd0fdea7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:27.341105 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-367d3ece-0d00-4576-b384-490fdd0fdea7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:27.483584 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-367d3ece-0d00-4576-b384-490fdd0fdea7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:27.491968 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-367d3ece-0d00-4576-b384-490fdd0fdea7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971" status: 200 len: 1682 microversion: 2.1 time: 0.165031 Sep 20 22:34:27.492530 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 526/1030] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:27 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:27.564215 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-54b98dfe-57a2-470a-89ee-f284bf2c4e78 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:27.564817 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-54b98dfe-57a2-470a-89ee-f284bf2c4e78 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:27.571559 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54b98dfe-57a2-470a-89ee-f284bf2c4e78 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:27.572122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54b98dfe-57a2-470a-89ee-f284bf2c4e78 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:27.572624 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54b98dfe-57a2-470a-89ee-f284bf2c4e78 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:27.573473 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54b98dfe-57a2-470a-89ee-f284bf2c4e78 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:27.573999 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54b98dfe-57a2-470a-89ee-f284bf2c4e78 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:27.574492 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-54b98dfe-57a2-470a-89ee-f284bf2c4e78 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:27.642000 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-54b98dfe-57a2-470a-89ee-f284bf2c4e78 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:27.650228 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-54b98dfe-57a2-470a-89ee-f284bf2c4e78 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1135 microversion: 2.1 time: 0.090413 Sep 20 22:34:27.650800 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 505/1031] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:27 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1135 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:28.519681 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-fb2c979d-4cf2-4d85-886c-250bb87116bc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:28.521250 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-fb2c979d-4cf2-4d85-886c-250bb87116bc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:28.527672 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fb2c979d-4cf2-4d85-886c-250bb87116bc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:28.528548 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fb2c979d-4cf2-4d85-886c-250bb87116bc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:28.529247 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fb2c979d-4cf2-4d85-886c-250bb87116bc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:28.530179 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fb2c979d-4cf2-4d85-886c-250bb87116bc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:28.530634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fb2c979d-4cf2-4d85-886c-250bb87116bc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:28.531054 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-fb2c979d-4cf2-4d85-886c-250bb87116bc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:28.620719 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-d387d492-5eb7-429b-823b-67b4e255d528 req-442a0d19-cdb8-484b-84a3-2f4591253903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2abce7e-ea74-4d2b-8d44-2e7889fe8971", "name": "network-vif-deleted", "tag": "00e67254-d3c8-4610-91f0-b807532d876b"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:34:28.639747 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-d387d492-5eb7-429b-823b-67b4e255d528 req-442a0d19-cdb8-484b-84a3-2f4591253903 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:28.649058 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-d387d492-5eb7-429b-823b-67b4e255d528 req-442a0d19-cdb8-484b-84a3-2f4591253903 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:28.649611 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-d387d492-5eb7-429b-823b-67b4e255d528 req-442a0d19-cdb8-484b-84a3-2f4591253903 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:28.669963 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-d387d492-5eb7-429b-823b-67b4e255d528 req-442a0d19-cdb8-484b-84a3-2f4591253903 service nova] Creating event network-vif-deleted:00e67254-d3c8-4610-91f0-b807532d876b for instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 on hv-cinder-85827 Sep 20 22:34:28.683172 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-d387d492-5eb7-429b-823b-67b4e255d528 req-442a0d19-cdb8-484b-84a3-2f4591253903 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062537 Sep 20 22:34:28.683895 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 506/1032] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:34:28.697685 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-27f680d4-853c-4e01-9085-ce0d09051aa1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:28.698414 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-27f680d4-853c-4e01-9085-ce0d09051aa1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:28.706419 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-fb2c979d-4cf2-4d85-886c-250bb87116bc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:28.709288 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-27f680d4-853c-4e01-9085-ce0d09051aa1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:28.714636 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-27f680d4-853c-4e01-9085-ce0d09051aa1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:28.715364 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-27f680d4-853c-4e01-9085-ce0d09051aa1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:28.716275 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-27f680d4-853c-4e01-9085-ce0d09051aa1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:28.716908 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-27f680d4-853c-4e01-9085-ce0d09051aa1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:28.717368 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-27f680d4-853c-4e01-9085-ce0d09051aa1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:28.718994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-fb2c979d-4cf2-4d85-886c-250bb87116bc tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971" status: 200 len: 1614 microversion: 2.1 time: 0.206242 Sep 20 22:34:28.721146 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 527/1033] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:28 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 => generated 1614 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:28.831198 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-27f680d4-853c-4e01-9085-ce0d09051aa1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:28.842617 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-27f680d4-853c-4e01-9085-ce0d09051aa1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1209 microversion: 2.1 time: 0.157133 Sep 20 22:34:28.843213 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 507/1034] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:28 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1209 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:29.747969 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-dc773264-a935-41bc-a6b8-7259dfe411e0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:29.749350 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-dc773264-a935-41bc-a6b8-7259dfe411e0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:29.756126 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dc773264-a935-41bc-a6b8-7259dfe411e0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:29.756876 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dc773264-a935-41bc-a6b8-7259dfe411e0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:29.757569 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dc773264-a935-41bc-a6b8-7259dfe411e0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:29.758478 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dc773264-a935-41bc-a6b8-7259dfe411e0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:29.759129 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dc773264-a935-41bc-a6b8-7259dfe411e0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:29.759791 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-dc773264-a935-41bc-a6b8-7259dfe411e0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:29.774554 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-dc773264-a935-41bc-a6b8-7259dfe411e0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] HTTP exception thrown: Instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 could not be found. Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-dc773264-a935-41bc-a6b8-7259dfe411e0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Request method failure captured: Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 HTTP/1.1 Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj9Aeyxjf5yMqHjDnCvmmvzhWQGzCrsBQuX_13kvowH7Ss-qoNBJb-Gfzs2nh_Wxq8YsnyXcveK6Mf9KXU9rYT6WvCgM2KCRhWvNuoaiFUsmz4N6dsiGMTW1t41Prgmfndkff0JZfffcZEBsySI2HYoAQ7I1a7TgST0Ce1eGA0Ik8Kw Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:34:29.776166 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:34:29.777689 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59af02f2b4984c6190870041aa020d75", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59af02f2b4984c6190870041aa020d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:34:29.777689 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:34:29.777689 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:34:29.777689 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:34:29.777689 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:34:29.777689 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:34:29.777689 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:34:29.777689 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 4af67f949fda43bf8967925f04491bd8 Sep 20 22:34:29.777689 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:34:29.777689 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:34:29.777689 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 could not be found. Sep 20 22:34:29.777689 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': 'b2abce7e-ea74-4d2b-8d44-2e7889fe8971'} Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 could not be found. Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:34:29.778515 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:34:29.779859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:34:29.779859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:34:29.779859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:34:29.779859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:34:29.779859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:34:29.779859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:34:29.779859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:34:29.779859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 could not be found. Sep 20 22:34:29.779859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:34:29.779859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:34:29.779859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:34:29.779859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:34:29.779859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:34:29.779859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:34:29.779859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:34:29.779859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:34:29.779859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 could not be found. Sep 20 22:34:29.779859 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:34:29.781855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-dc773264-a935-41bc-a6b8-7259dfe411e0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Returning 404 to user: Instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:34:29.781855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-dc773264-a935-41bc-a6b8-7259dfe411e0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971" status: 404 len: 111 microversion: 2.1 time: 0.033798 Sep 20 22:34:29.781855 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 528/1035] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:29 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:34:29.786856 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-7a730bc8-98f1-490c-8433-126c9d9ebc63 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '.version_select at 0x7f24f66949d0>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:29.806821 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-7a730bc8-98f1-490c-8433-126c9d9ebc63 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1580183203" status: 202 len: 0 microversion: 2.1 time: 0.023886 Sep 20 22:34:29.807746 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 508/1036] 10.222.0.16 () {58 vars in 1221 bytes} [Tue Sep 20 22:34:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1580183203 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:34:29.928818 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-61b11f6a-0055-4930-b866-ee151fbd63fa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:29.929476 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-61b11f6a-0055-4930-b866-ee151fbd63fa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:29.935319 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61b11f6a-0055-4930-b866-ee151fbd63fa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:29.935796 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61b11f6a-0055-4930-b866-ee151fbd63fa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:29.936229 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61b11f6a-0055-4930-b866-ee151fbd63fa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:29.937066 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61b11f6a-0055-4930-b866-ee151fbd63fa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:29.937516 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61b11f6a-0055-4930-b866-ee151fbd63fa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:29.937949 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-61b11f6a-0055-4930-b866-ee151fbd63fa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:30.170820 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-ef112d09-32e7-4e76-9a54-8e8fb9394099 req-b6f4a69f-1043-4d05-b5e1-7f5b6012a5ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e774edc1-1d20-4540-b590-2e5a67ab17c7", "tag": "84111c91-8792-4d28-85ba-d23ba9e2ef0a"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:34:30.183123 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-ef112d09-32e7-4e76-9a54-8e8fb9394099 req-b6f4a69f-1043-4d05-b5e1-7f5b6012a5ba service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:30.183891 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-ef112d09-32e7-4e76-9a54-8e8fb9394099 req-b6f4a69f-1043-4d05-b5e1-7f5b6012a5ba service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:30.184557 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-ef112d09-32e7-4e76-9a54-8e8fb9394099 req-b6f4a69f-1043-4d05-b5e1-7f5b6012a5ba service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:30.204519 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-ef112d09-32e7-4e76-9a54-8e8fb9394099 req-b6f4a69f-1043-4d05-b5e1-7f5b6012a5ba service nova] Creating event network-changed:84111c91-8792-4d28-85ba-d23ba9e2ef0a for instance e774edc1-1d20-4540-b590-2e5a67ab17c7 on hv-cinder-85827 Sep 20 22:34:30.212212 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-ef112d09-32e7-4e76-9a54-8e8fb9394099 req-b6f4a69f-1043-4d05-b5e1-7f5b6012a5ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112859 Sep 20 22:34:30.213767 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 509/1037] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:34:30.228224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-61b11f6a-0055-4930-b866-ee151fbd63fa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:30.236753 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-61b11f6a-0055-4930-b866-ee151fbd63fa tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1265 microversion: 2.1 time: 0.367533 Sep 20 22:34:30.249559 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 529/1038] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:29 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1265 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:30.620536 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-3b376487-eeaa-489d-a783-e7dfe92cc887 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Action: 'create', calling method: .version_select at 0x7f24f68b94c0>, body: {"keypair": {"name": "tempest-keypair-1128653018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYOTQl2I52XgiJ/v9nA4/Kj50VL8+9BzFkacTk4a4XsgTJxv3oQicui2i1Z1ynksHe9f9YYAa5KjiOdht60DDLRQLHjKnM5mGYqWAdyLzOu7/eKA8LI1TW7AWxbU5vysg=="}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:34:30.635626 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-3b376487-eeaa-489d-a783-e7dfe92cc887 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Getting quotas for project 59af02f2b4984c6190870041aa020d75. Resources: {'key_pairs'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:34:30.639456 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-3b376487-eeaa-489d-a783-e7dfe92cc887 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Getting quotas for user 4af67f949fda43bf8967925f04491bd8 and project 59af02f2b4984c6190870041aa020d75. Resources: {'key_pairs'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:34:30.661401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-3b376487-eeaa-489d-a783-e7dfe92cc887 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045293 Sep 20 22:34:30.661913 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 510/1039] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 20 22:34:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:34:31.262420 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b7f4fd8e-91e5-412c-b95e-0979fde040d9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:31.263205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b7f4fd8e-91e5-412c-b95e-0979fde040d9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:31.270300 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b7f4fd8e-91e5-412c-b95e-0979fde040d9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:31.271028 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b7f4fd8e-91e5-412c-b95e-0979fde040d9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:31.271819 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b7f4fd8e-91e5-412c-b95e-0979fde040d9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:31.272699 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b7f4fd8e-91e5-412c-b95e-0979fde040d9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:31.273491 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b7f4fd8e-91e5-412c-b95e-0979fde040d9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:31.274076 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b7f4fd8e-91e5-412c-b95e-0979fde040d9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:31.408510 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b7f4fd8e-91e5-412c-b95e-0979fde040d9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:31.416237 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b7f4fd8e-91e5-412c-b95e-0979fde040d9 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1265 microversion: 2.1 time: 0.159203 Sep 20 22:34:31.416807 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 530/1040] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:31 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:31.918027 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-d40c4e1e-7a7d-4de4-a67b-827fe658edff tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1675500418", "imageRef": "a1be001e-c2e4-44b7-b0d2-af96de3855c4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fdd6da27-ff07-48de-8020-aad44ec6dade"}], "security_groups": [{"name": "tempest-securitygroup--969876302"}], "key_name": "tempest-keypair-1128653018", "user_data": "}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:34:32.026222 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.network.neutron [None req-d40c4e1e-7a7d-4de4-a67b-827fe658edff tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] validate_networks() for [('fdd6da27-ff07-48de-8020-aad44ec6dade', None, None, None, None, None)] {{(pid=120473) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 20 22:34:32.395707 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-d40c4e1e-7a7d-4de4-a67b-827fe658edff tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Flavor limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 20 22:34:32.396133 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-d40c4e1e-7a7d-4de4-a67b-827fe658edff tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Image limits 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 20 22:34:32.396606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-d40c4e1e-7a7d-4de4-a67b-827fe658edff tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Flavor pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 20 22:34:32.397041 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-d40c4e1e-7a7d-4de4-a67b-827fe658edff tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Image pref 0:0:0 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 20 22:34:32.397482 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.virt.hardware [None req-d40c4e1e-7a7d-4de4-a67b-827fe658edff tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120473) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 20 22:34:32.406482 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d40c4e1e-7a7d-4de4-a67b-827fe658edff tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:32.406963 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d40c4e1e-7a7d-4de4-a67b-827fe658edff tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:32.407396 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d40c4e1e-7a7d-4de4-a67b-827fe658edff tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:32.408118 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d40c4e1e-7a7d-4de4-a67b-827fe658edff tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:32.408569 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d40c4e1e-7a7d-4de4-a67b-827fe658edff tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:32.409019 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-d40c4e1e-7a7d-4de4-a67b-827fe658edff tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:32.425620 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-d40c4e1e-7a7d-4de4-a67b-827fe658edff tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Getting quotas for project 59af02f2b4984c6190870041aa020d75. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 20 22:34:32.429525 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.quota [None req-d40c4e1e-7a7d-4de4-a67b-827fe658edff tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Getting quotas for user 4af67f949fda43bf8967925f04491bd8 and project 59af02f2b4984c6190870041aa020d75. Resources: {'ram', 'cores', 'instances'} {{(pid=120473) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 20 22:34:32.438487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-678cfde3-1316-4e10-82c0-7b19c9008d3d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:32.439204 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-678cfde3-1316-4e10-82c0-7b19c9008d3d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:32.440478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d40c4e1e-7a7d-4de4-a67b-827fe658edff tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Going to run 1 instances... {{(pid=120473) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 20 22:34:32.443446 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-d40c4e1e-7a7d-4de4-a67b-827fe658edff tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a1be001e-c2e4-44b7-b0d2-af96de3855c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120473) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 20 22:34:32.446098 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-678cfde3-1316-4e10-82c0-7b19c9008d3d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:32.446580 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-678cfde3-1316-4e10-82c0-7b19c9008d3d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:32.447016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-678cfde3-1316-4e10-82c0-7b19c9008d3d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:32.447703 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-678cfde3-1316-4e10-82c0-7b19c9008d3d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:32.448155 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-678cfde3-1316-4e10-82c0-7b19c9008d3d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:32.448573 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-678cfde3-1316-4e10-82c0-7b19c9008d3d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:32.489994 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-d40c4e1e-7a7d-4de4-a67b-827fe658edff tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.576275 Sep 20 22:34:32.497221 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 511/1041] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 20 22:34:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 20 22:34:32.502010 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-fd9025de-b204-4334-8133-1fb386fc406c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:32.502630 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-fd9025de-b204-4334-8133-1fb386fc406c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:32.556854 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-fd9025de-b204-4334-8133-1fb386fc406c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:32.565125 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-fd9025de-b204-4334-8133-1fb386fc406c tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b" status: 200 len: 1242 microversion: 2.1 time: 0.066824 Sep 20 22:34:32.565702 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 512/1042] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:32 2022] GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:34:32.596872 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-678cfde3-1316-4e10-82c0-7b19c9008d3d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:32.605135 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-678cfde3-1316-4e10-82c0-7b19c9008d3d tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1265 microversion: 2.1 time: 0.170472 Sep 20 22:34:32.605777 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 531/1043] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:32 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:34:33.593482 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0435525c-3683-4fe8-8bc6-fef2e840c2b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:33.593864 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-0435525c-3683-4fe8-8bc6-fef2e840c2b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:33.601816 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0435525c-3683-4fe8-8bc6-fef2e840c2b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:33.602307 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0435525c-3683-4fe8-8bc6-fef2e840c2b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:33.602748 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0435525c-3683-4fe8-8bc6-fef2e840c2b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:33.603453 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0435525c-3683-4fe8-8bc6-fef2e840c2b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:33.604091 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0435525c-3683-4fe8-8bc6-fef2e840c2b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:33.604519 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0435525c-3683-4fe8-8bc6-fef2e840c2b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:33.627794 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-81c8749b-d679-40d9-847d-791053b49abd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:33.628712 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-81c8749b-d679-40d9-847d-791053b49abd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:33.636182 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-81c8749b-d679-40d9-847d-791053b49abd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:33.637089 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-81c8749b-d679-40d9-847d-791053b49abd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:33.637636 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-81c8749b-d679-40d9-847d-791053b49abd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:33.638447 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-81c8749b-d679-40d9-847d-791053b49abd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:33.639277 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-81c8749b-d679-40d9-847d-791053b49abd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:33.639821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-81c8749b-d679-40d9-847d-791053b49abd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:33.676731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-0435525c-3683-4fe8-8bc6-fef2e840c2b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:33.684521 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-0435525c-3683-4fe8-8bc6-fef2e840c2b4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b" status: 200 len: 1300 microversion: 2.1 time: 0.098753 Sep 20 22:34:33.685114 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 513/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:33 2022] GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b => generated 1300 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:33.853330 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-81c8749b-d679-40d9-847d-791053b49abd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:33.861260 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-81c8749b-d679-40d9-847d-791053b49abd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1265 microversion: 2.1 time: 0.237722 Sep 20 22:34:33.861845 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 532/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:33 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:34.707822 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a182eae7-6ade-4373-a56d-31df52b70eec tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:34.708447 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a182eae7-6ade-4373-a56d-31df52b70eec tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:34.714976 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a182eae7-6ade-4373-a56d-31df52b70eec tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:34.715456 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a182eae7-6ade-4373-a56d-31df52b70eec tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:34.716023 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a182eae7-6ade-4373-a56d-31df52b70eec tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:34.716716 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a182eae7-6ade-4373-a56d-31df52b70eec tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:34.717194 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a182eae7-6ade-4373-a56d-31df52b70eec tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:34.717614 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a182eae7-6ade-4373-a56d-31df52b70eec tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:34.843675 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a182eae7-6ade-4373-a56d-31df52b70eec tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:34.852133 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a182eae7-6ade-4373-a56d-31df52b70eec tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b" status: 200 len: 1367 microversion: 2.1 time: 0.148348 Sep 20 22:34:34.852710 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 514/1046] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:34 2022] GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:34.883322 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-88c74f73-7bde-4642-93c1-8ca6b3271d5b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:34.883957 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-88c74f73-7bde-4642-93c1-8ca6b3271d5b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:34.890824 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-88c74f73-7bde-4642-93c1-8ca6b3271d5b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:34.891312 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-88c74f73-7bde-4642-93c1-8ca6b3271d5b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:34.891894 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-88c74f73-7bde-4642-93c1-8ca6b3271d5b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:34.892593 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-88c74f73-7bde-4642-93c1-8ca6b3271d5b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:34.893112 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-88c74f73-7bde-4642-93c1-8ca6b3271d5b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:34.893537 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-88c74f73-7bde-4642-93c1-8ca6b3271d5b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:34.941008 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-8b286444-863d-4177-996d-624e3ebd225f req-7736af08-63d6-4e1c-b021-41493c574b58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7300b0c9-eba6-466d-b7bf-2e88bbcdd18b", "tag": "23bb60e8-6565-4871-a176-d16b25c402c1"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:34:34.952245 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-8b286444-863d-4177-996d-624e3ebd225f req-7736af08-63d6-4e1c-b021-41493c574b58 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:34.952723 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-8b286444-863d-4177-996d-624e3ebd225f req-7736af08-63d6-4e1c-b021-41493c574b58 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:34.953196 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-8b286444-863d-4177-996d-624e3ebd225f req-7736af08-63d6-4e1c-b021-41493c574b58 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:34.966141 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-8b286444-863d-4177-996d-624e3ebd225f req-7736af08-63d6-4e1c-b021-41493c574b58 service nova] Creating event network-changed:23bb60e8-6565-4871-a176-d16b25c402c1 for instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b on hv-cinder-85827 Sep 20 22:34:34.971231 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-8b286444-863d-4177-996d-624e3ebd225f req-7736af08-63d6-4e1c-b021-41493c574b58 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033966 Sep 20 22:34:34.971843 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 515/1047] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:34:35.167143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-88c74f73-7bde-4642-93c1-8ca6b3271d5b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:35.175146 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-88c74f73-7bde-4642-93c1-8ca6b3271d5b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1265 microversion: 2.1 time: 0.295557 Sep 20 22:34:35.175750 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 533/1048] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:34 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1265 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:35.876350 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a00dc3cc-fa6f-4fe4-86a8-255eb8fb1d95 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:35.877088 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a00dc3cc-fa6f-4fe4-86a8-255eb8fb1d95 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:35.884482 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a00dc3cc-fa6f-4fe4-86a8-255eb8fb1d95 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:35.885026 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a00dc3cc-fa6f-4fe4-86a8-255eb8fb1d95 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:35.885502 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a00dc3cc-fa6f-4fe4-86a8-255eb8fb1d95 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:35.886195 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a00dc3cc-fa6f-4fe4-86a8-255eb8fb1d95 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:35.886646 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a00dc3cc-fa6f-4fe4-86a8-255eb8fb1d95 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:35.887081 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a00dc3cc-fa6f-4fe4-86a8-255eb8fb1d95 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:36.012575 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a00dc3cc-fa6f-4fe4-86a8-255eb8fb1d95 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:36.020145 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a00dc3cc-fa6f-4fe4-86a8-255eb8fb1d95 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b" status: 200 len: 1367 microversion: 2.1 time: 0.148023 Sep 20 22:34:36.020715 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 516/1049] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:35 2022] GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:36.197088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-8e18cde5-0f1e-4dee-8ef7-3d30ea531a56 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:36.197693 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-8e18cde5-0f1e-4dee-8ef7-3d30ea531a56 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:36.203993 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8e18cde5-0f1e-4dee-8ef7-3d30ea531a56 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:36.204470 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8e18cde5-0f1e-4dee-8ef7-3d30ea531a56 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:36.204898 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8e18cde5-0f1e-4dee-8ef7-3d30ea531a56 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:36.205600 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8e18cde5-0f1e-4dee-8ef7-3d30ea531a56 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:36.206049 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8e18cde5-0f1e-4dee-8ef7-3d30ea531a56 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:36.206467 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8e18cde5-0f1e-4dee-8ef7-3d30ea531a56 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:36.267687 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=2 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:36.288556 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell0:SELECT=6 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:36.335411 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-8e18cde5-0f1e-4dee-8ef7-3d30ea531a56 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:36.342994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-8e18cde5-0f1e-4dee-8ef7-3d30ea531a56 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1265 microversion: 2.1 time: 0.149739 Sep 20 22:34:36.343555 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 534/1050] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:36 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:37.042852 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-c9db84bb-9f99-4f33-8ec4-e02c8507a3e6 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:37.043581 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-c9db84bb-9f99-4f33-8ec4-e02c8507a3e6 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:37.049885 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c9db84bb-9f99-4f33-8ec4-e02c8507a3e6 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:37.050371 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c9db84bb-9f99-4f33-8ec4-e02c8507a3e6 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:37.050809 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c9db84bb-9f99-4f33-8ec4-e02c8507a3e6 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:37.051508 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c9db84bb-9f99-4f33-8ec4-e02c8507a3e6 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:37.051953 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c9db84bb-9f99-4f33-8ec4-e02c8507a3e6 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:37.052383 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-c9db84bb-9f99-4f33-8ec4-e02c8507a3e6 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:37.070519 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:37.183297 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-c9db84bb-9f99-4f33-8ec4-e02c8507a3e6 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:37.191560 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-c9db84bb-9f99-4f33-8ec4-e02c8507a3e6 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b" status: 200 len: 1367 microversion: 2.1 time: 0.152058 Sep 20 22:34:37.192333 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 517/1051] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:37 2022] GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:37.366505 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-1e1b0e8a-77df-4036-a2fa-5a92061963c3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:37.367140 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-1e1b0e8a-77df-4036-a2fa-5a92061963c3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:37.373903 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1e1b0e8a-77df-4036-a2fa-5a92061963c3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:37.374391 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1e1b0e8a-77df-4036-a2fa-5a92061963c3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:37.374821 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1e1b0e8a-77df-4036-a2fa-5a92061963c3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:37.375512 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1e1b0e8a-77df-4036-a2fa-5a92061963c3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:37.375959 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1e1b0e8a-77df-4036-a2fa-5a92061963c3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:37.376402 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-1e1b0e8a-77df-4036-a2fa-5a92061963c3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:37.508675 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-1e1b0e8a-77df-4036-a2fa-5a92061963c3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:37.516261 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-1e1b0e8a-77df-4036-a2fa-5a92061963c3 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1265 microversion: 2.1 time: 0.154215 Sep 20 22:34:37.516845 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 535/1052] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:37 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:38.214133 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-30320eb6-6e0d-447d-b3d0-5b618a6b9261 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:38.214753 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-30320eb6-6e0d-447d-b3d0-5b618a6b9261 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:38.221210 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30320eb6-6e0d-447d-b3d0-5b618a6b9261 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:38.221703 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30320eb6-6e0d-447d-b3d0-5b618a6b9261 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:38.222814 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30320eb6-6e0d-447d-b3d0-5b618a6b9261 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:38.223514 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30320eb6-6e0d-447d-b3d0-5b618a6b9261 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:38.223973 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30320eb6-6e0d-447d-b3d0-5b618a6b9261 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:38.224402 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-30320eb6-6e0d-447d-b3d0-5b618a6b9261 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:38.351399 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-30320eb6-6e0d-447d-b3d0-5b618a6b9261 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:38.358912 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-30320eb6-6e0d-447d-b3d0-5b618a6b9261 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b" status: 200 len: 1367 microversion: 2.1 time: 0.148701 Sep 20 22:34:38.359477 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 518/1053] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:38 2022] GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:38.538484 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-36b4d1db-a0e7-4663-9163-aec6773a70fe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:38.539097 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-36b4d1db-a0e7-4663-9163-aec6773a70fe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:38.545548 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-36b4d1db-a0e7-4663-9163-aec6773a70fe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:38.546028 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-36b4d1db-a0e7-4663-9163-aec6773a70fe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:38.546458 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-36b4d1db-a0e7-4663-9163-aec6773a70fe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:38.547140 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-36b4d1db-a0e7-4663-9163-aec6773a70fe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:38.547593 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-36b4d1db-a0e7-4663-9163-aec6773a70fe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:38.548021 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-36b4d1db-a0e7-4663-9163-aec6773a70fe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:38.674978 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-36b4d1db-a0e7-4663-9163-aec6773a70fe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:38.682675 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-36b4d1db-a0e7-4663-9163-aec6773a70fe tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1265 microversion: 2.1 time: 0.148090 Sep 20 22:34:38.683244 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 536/1054] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:38 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:39.381797 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a72b90ae-0fb5-4bab-bd25-5509d52eb6ce tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:39.382410 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-a72b90ae-0fb5-4bab-bd25-5509d52eb6ce tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:39.388757 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a72b90ae-0fb5-4bab-bd25-5509d52eb6ce tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:39.389273 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a72b90ae-0fb5-4bab-bd25-5509d52eb6ce tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:39.389713 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a72b90ae-0fb5-4bab-bd25-5509d52eb6ce tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:39.390406 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a72b90ae-0fb5-4bab-bd25-5509d52eb6ce tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:39.390861 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a72b90ae-0fb5-4bab-bd25-5509d52eb6ce tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:39.391284 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-a72b90ae-0fb5-4bab-bd25-5509d52eb6ce tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:39.519446 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-a72b90ae-0fb5-4bab-bd25-5509d52eb6ce tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:39.527695 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a72b90ae-0fb5-4bab-bd25-5509d52eb6ce tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b" status: 200 len: 1367 microversion: 2.1 time: 0.149788 Sep 20 22:34:39.528263 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 519/1055] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:39 2022] GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:39.705501 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a6092393-cb8b-49a4-b645-d6a331149d54 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:39.706131 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a6092393-cb8b-49a4-b645-d6a331149d54 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:39.712803 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a6092393-cb8b-49a4-b645-d6a331149d54 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:39.713319 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a6092393-cb8b-49a4-b645-d6a331149d54 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:39.713760 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a6092393-cb8b-49a4-b645-d6a331149d54 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:39.714452 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a6092393-cb8b-49a4-b645-d6a331149d54 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:39.714909 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a6092393-cb8b-49a4-b645-d6a331149d54 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:39.715328 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a6092393-cb8b-49a4-b645-d6a331149d54 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:39.849133 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a6092393-cb8b-49a4-b645-d6a331149d54 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:39.857699 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a6092393-cb8b-49a4-b645-d6a331149d54 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1265 microversion: 2.1 time: 0.155996 Sep 20 22:34:39.858452 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 537/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:39 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:39.976313 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-8f99fad7-7b76-4fbd-9f38-7752e07f9cba req-6e5e1d2b-c7b3-45ff-999b-0f5c81d56eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7300b0c9-eba6-466d-b7bf-2e88bbcdd18b", "name": "network-vif-plugged", "status": "completed", "tag": "23bb60e8-6565-4871-a176-d16b25c402c1"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:34:39.988815 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-8f99fad7-7b76-4fbd-9f38-7752e07f9cba req-6e5e1d2b-c7b3-45ff-999b-0f5c81d56eb3 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:39.989964 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-8f99fad7-7b76-4fbd-9f38-7752e07f9cba req-6e5e1d2b-c7b3-45ff-999b-0f5c81d56eb3 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:39.990395 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-8f99fad7-7b76-4fbd-9f38-7752e07f9cba req-6e5e1d2b-c7b3-45ff-999b-0f5c81d56eb3 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:40.002621 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-8f99fad7-7b76-4fbd-9f38-7752e07f9cba req-6e5e1d2b-c7b3-45ff-999b-0f5c81d56eb3 service nova] Creating event network-vif-plugged:23bb60e8-6565-4871-a176-d16b25c402c1 for instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b on hv-cinder-85827 Sep 20 22:34:40.007898 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-8f99fad7-7b76-4fbd-9f38-7752e07f9cba req-6e5e1d2b-c7b3-45ff-999b-0f5c81d56eb3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036217 Sep 20 22:34:40.008873 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 520/1057] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:34:40.550888 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-b9287ca3-d371-4c77-89aa-5548b6631ea0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:40.551415 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-b9287ca3-d371-4c77-89aa-5548b6631ea0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:40.557476 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b9287ca3-d371-4c77-89aa-5548b6631ea0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:40.557954 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b9287ca3-d371-4c77-89aa-5548b6631ea0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:40.558384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b9287ca3-d371-4c77-89aa-5548b6631ea0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:40.559067 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b9287ca3-d371-4c77-89aa-5548b6631ea0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:40.559519 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b9287ca3-d371-4c77-89aa-5548b6631ea0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:40.559944 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-b9287ca3-d371-4c77-89aa-5548b6631ea0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:40.684136 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-b9287ca3-d371-4c77-89aa-5548b6631ea0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:40.691626 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-b9287ca3-d371-4c77-89aa-5548b6631ea0 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b" status: 200 len: 1367 microversion: 2.1 time: 0.144694 Sep 20 22:34:40.692706 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 538/1058] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:40 2022] GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:40.885050 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-2f206e29-2fae-4c67-a241-d056228bb9c1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:40.885769 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-2f206e29-2fae-4c67-a241-d056228bb9c1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:40.892521 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2f206e29-2fae-4c67-a241-d056228bb9c1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:40.893043 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2f206e29-2fae-4c67-a241-d056228bb9c1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:40.893495 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2f206e29-2fae-4c67-a241-d056228bb9c1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:40.894189 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2f206e29-2fae-4c67-a241-d056228bb9c1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:40.894652 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2f206e29-2fae-4c67-a241-d056228bb9c1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:40.895076 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-2f206e29-2fae-4c67-a241-d056228bb9c1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:41.023063 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-2f206e29-2fae-4c67-a241-d056228bb9c1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:41.030700 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-2f206e29-2fae-4c67-a241-d056228bb9c1 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1265 microversion: 2.1 time: 0.149891 Sep 20 22:34:41.031260 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 521/1059] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:40 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:34:41.714819 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-12947804-4111-461e-917c-a4d6744b1376 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:41.715666 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-12947804-4111-461e-917c-a4d6744b1376 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:41.723162 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-12947804-4111-461e-917c-a4d6744b1376 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:41.724171 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-12947804-4111-461e-917c-a4d6744b1376 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:41.724642 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-12947804-4111-461e-917c-a4d6744b1376 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:41.725544 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-12947804-4111-461e-917c-a4d6744b1376 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:41.726039 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-12947804-4111-461e-917c-a4d6744b1376 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:41.726689 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-12947804-4111-461e-917c-a4d6744b1376 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:41.863281 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-12947804-4111-461e-917c-a4d6744b1376 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:41.875516 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-12947804-4111-461e-917c-a4d6744b1376 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b" status: 200 len: 1557 microversion: 2.1 time: 0.165075 Sep 20 22:34:41.876096 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 539/1060] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:41 2022] GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:41.899153 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-eff6c139-c5aa-44a0-8e5b-7b8bb1625669 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:41.899737 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-eff6c139-c5aa-44a0-8e5b-7b8bb1625669 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:41.906932 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-eff6c139-c5aa-44a0-8e5b-7b8bb1625669 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:41.907621 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-eff6c139-c5aa-44a0-8e5b-7b8bb1625669 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:41.908045 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-eff6c139-c5aa-44a0-8e5b-7b8bb1625669 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:41.908928 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-eff6c139-c5aa-44a0-8e5b-7b8bb1625669 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:41.909409 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-eff6c139-c5aa-44a0-8e5b-7b8bb1625669 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:41.909830 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-eff6c139-c5aa-44a0-8e5b-7b8bb1625669 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:41.986457 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-eff6c139-c5aa-44a0-8e5b-7b8bb1625669 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091939 Sep 20 22:34:41.987055 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 522/1061] 10.222.0.16 () {58 vars in 1275 bytes} [Tue Sep 20 22:34:41 2022] GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:34:42.053224 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5be368b3-47ef-4074-8183-460c34bc20c2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:42.053833 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5be368b3-47ef-4074-8183-460c34bc20c2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:42.059662 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5be368b3-47ef-4074-8183-460c34bc20c2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:42.060137 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5be368b3-47ef-4074-8183-460c34bc20c2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:42.060564 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5be368b3-47ef-4074-8183-460c34bc20c2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:42.061299 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5be368b3-47ef-4074-8183-460c34bc20c2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:42.061744 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5be368b3-47ef-4074-8183-460c34bc20c2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:42.062162 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5be368b3-47ef-4074-8183-460c34bc20c2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:42.066313 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=100 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:42.150200 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-eb54222c-c962-431e-bd9e-85bcdc706601 req-35c05557-7089-4a6a-ace5-271cbc693f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e774edc1-1d20-4540-b590-2e5a67ab17c7", "name": "network-vif-plugged", "status": "completed", "tag": "84111c91-8792-4d28-85ba-d23ba9e2ef0a"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:34:42.160131 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-eb54222c-c962-431e-bd9e-85bcdc706601 req-35c05557-7089-4a6a-ace5-271cbc693f21 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:42.160613 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-eb54222c-c962-431e-bd9e-85bcdc706601 req-35c05557-7089-4a6a-ace5-271cbc693f21 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:42.161824 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-eb54222c-c962-431e-bd9e-85bcdc706601 req-35c05557-7089-4a6a-ace5-271cbc693f21 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:42.173628 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-eb54222c-c962-431e-bd9e-85bcdc706601 req-35c05557-7089-4a6a-ace5-271cbc693f21 service nova] Creating event network-vif-plugged:84111c91-8792-4d28-85ba-d23ba9e2ef0a for instance e774edc1-1d20-4540-b590-2e5a67ab17c7 on hv-cinder-85827 Sep 20 22:34:42.179106 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-eb54222c-c962-431e-bd9e-85bcdc706601 req-35c05557-7089-4a6a-ace5-271cbc693f21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032570 Sep 20 22:34:42.179925 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 523/1062] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:34:42.203100 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-5be368b3-47ef-4074-8183-460c34bc20c2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:42.214315 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5be368b3-47ef-4074-8183-460c34bc20c2 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1265 microversion: 2.1 time: 0.165211 Sep 20 22:34:42.214994 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 540/1063] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:42 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:43.178072 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=2 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:43.178987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell0:SELECT=14 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:43.183846 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-56301679-2bee-4825-be0a-7b3ff274ab10 req-c06c1b5d-d196-4d7f-a381-6c7bd2a2177a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7300b0c9-eba6-466d-b7bf-2e88bbcdd18b", "tag": "23bb60e8-6565-4871-a176-d16b25c402c1"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:34:43.195078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-56301679-2bee-4825-be0a-7b3ff274ab10 req-c06c1b5d-d196-4d7f-a381-6c7bd2a2177a service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:43.195559 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-56301679-2bee-4825-be0a-7b3ff274ab10 req-c06c1b5d-d196-4d7f-a381-6c7bd2a2177a service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:43.196259 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-56301679-2bee-4825-be0a-7b3ff274ab10 req-c06c1b5d-d196-4d7f-a381-6c7bd2a2177a service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:43.207381 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-56301679-2bee-4825-be0a-7b3ff274ab10 req-c06c1b5d-d196-4d7f-a381-6c7bd2a2177a service nova] Creating event network-changed:23bb60e8-6565-4871-a176-d16b25c402c1 for instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b on hv-cinder-85827 Sep 20 22:34:43.213247 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-56301679-2bee-4825-be0a-7b3ff274ab10 req-c06c1b5d-d196-4d7f-a381-6c7bd2a2177a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036052 Sep 20 22:34:43.214134 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 524/1064] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:34:43.237537 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-e86521e9-257b-4daa-adb5-0827d290561e tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:43.238098 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-e86521e9-257b-4daa-adb5-0827d290561e tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:43.244092 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e86521e9-257b-4daa-adb5-0827d290561e tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:43.244832 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e86521e9-257b-4daa-adb5-0827d290561e tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:43.245538 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e86521e9-257b-4daa-adb5-0827d290561e tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:43.246237 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e86521e9-257b-4daa-adb5-0827d290561e tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:43.246909 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e86521e9-257b-4daa-adb5-0827d290561e tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:43.247503 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-e86521e9-257b-4daa-adb5-0827d290561e tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:43.439455 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-e86521e9-257b-4daa-adb5-0827d290561e tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:43.448053 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-e86521e9-257b-4daa-adb5-0827d290561e tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1265 microversion: 2.1 time: 0.214844 Sep 20 22:34:43.448634 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 541/1065] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:43 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:44.471627 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-7be079d7-845b-48a0-b4cf-3635a903244f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:44.472304 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-7be079d7-845b-48a0-b4cf-3635a903244f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:44.478434 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7be079d7-845b-48a0-b4cf-3635a903244f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:44.478951 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7be079d7-845b-48a0-b4cf-3635a903244f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:44.479389 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7be079d7-845b-48a0-b4cf-3635a903244f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:44.480076 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7be079d7-845b-48a0-b4cf-3635a903244f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:44.480533 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7be079d7-845b-48a0-b4cf-3635a903244f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:44.480957 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-7be079d7-845b-48a0-b4cf-3635a903244f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:44.609850 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-7be079d7-845b-48a0-b4cf-3635a903244f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:44.617624 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-7be079d7-845b-48a0-b4cf-3635a903244f tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1452 microversion: 2.1 time: 0.151075 Sep 20 22:34:44.618187 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 525/1066] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:44 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:44.639877 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-8c9b64d7-3301-4013-8ab7-397362b23735 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:34:44.640492 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-8c9b64d7-3301-4013-8ab7-397362b23735 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:34:44.647777 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8c9b64d7-3301-4013-8ab7-397362b23735 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:44.648286 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8c9b64d7-3301-4013-8ab7-397362b23735 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:44.648719 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8c9b64d7-3301-4013-8ab7-397362b23735 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:44.649446 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8c9b64d7-3301-4013-8ab7-397362b23735 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:44.649904 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8c9b64d7-3301-4013-8ab7-397362b23735 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:44.650328 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-8c9b64d7-3301-4013-8ab7-397362b23735 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:44.782131 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-8c9b64d7-3301-4013-8ab7-397362b23735 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:34:44.789870 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-8c9b64d7-3301-4013-8ab7-397362b23735 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1452 microversion: 2.1 time: 0.153771 Sep 20 22:34:44.790443 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 542/1067] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:34:44 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:34:46.335645 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-165e50b7-369d-4f15-97c2-6a685f2e88ae req-981f89c3-12e1-4ccf-80b0-b58da734e1bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e774edc1-1d20-4540-b590-2e5a67ab17c7", "tag": "84111c91-8792-4d28-85ba-d23ba9e2ef0a"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:34:46.345372 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-165e50b7-369d-4f15-97c2-6a685f2e88ae req-981f89c3-12e1-4ccf-80b0-b58da734e1bc service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:34:46.345846 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-165e50b7-369d-4f15-97c2-6a685f2e88ae req-981f89c3-12e1-4ccf-80b0-b58da734e1bc service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:34:46.347549 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-165e50b7-369d-4f15-97c2-6a685f2e88ae req-981f89c3-12e1-4ccf-80b0-b58da734e1bc service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:34:46.357520 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-165e50b7-369d-4f15-97c2-6a685f2e88ae req-981f89c3-12e1-4ccf-80b0-b58da734e1bc service nova] Creating event network-changed:84111c91-8792-4d28-85ba-d23ba9e2ef0a for instance e774edc1-1d20-4540-b590-2e5a67ab17c7 on hv-cinder-85827 Sep 20 22:34:46.362359 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-165e50b7-369d-4f15-97c2-6a685f2e88ae req-981f89c3-12e1-4ccf-80b0-b58da734e1bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030869 Sep 20 22:34:46.362977 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 526/1068] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:35:19.083205 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-f4b79425-088b-4127-8d97-c6a60790e5c4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:19.083770 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-f4b79425-088b-4127-8d97-c6a60790e5c4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:35:19.085835 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:35:19.086487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=16 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:35:19.092628 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f4b79425-088b-4127-8d97-c6a60790e5c4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:19.093144 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f4b79425-088b-4127-8d97-c6a60790e5c4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:19.093580 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f4b79425-088b-4127-8d97-c6a60790e5c4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:19.094269 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f4b79425-088b-4127-8d97-c6a60790e5c4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:19.094721 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f4b79425-088b-4127-8d97-c6a60790e5c4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:19.095143 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-f4b79425-088b-4127-8d97-c6a60790e5c4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:19.118936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-f4b79425-088b-4127-8d97-c6a60790e5c4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b/ips" status: 200 len: 150 microversion: 2.1 time: 0.039833 Sep 20 22:35:19.119497 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 543/1069] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 20 22:35:19 2022] GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:35:20.440397 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:35:20.441170 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=38 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:35:20.445640 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-3d5630cf-fd83-40f6-a0a6-c67905c198b3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ed4eff9-68b0-4a97-9c99-4431ebdb34e4"}} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:35:20.448080 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-3d5630cf-fd83-40f6-a0a6-c67905c198b3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:35:20.456305 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3d5630cf-fd83-40f6-a0a6-c67905c198b3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:20.456790 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3d5630cf-fd83-40f6-a0a6-c67905c198b3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:20.457257 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3d5630cf-fd83-40f6-a0a6-c67905c198b3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:20.457949 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3d5630cf-fd83-40f6-a0a6-c67905c198b3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:20.458403 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3d5630cf-fd83-40f6-a0a6-c67905c198b3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:20.458826 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3d5630cf-fd83-40f6-a0a6-c67905c198b3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:20.693649 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-3d5630cf-fd83-40f6-a0a6-c67905c198b3 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "POST /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254540 Sep 20 22:35:20.694265 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 527/1070] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 20 22:35:20 2022] POST /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:35:27.272686 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-977008b3-3ab2-4973-a042-3cf1d340b1e9 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:27.273278 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-977008b3-3ab2-4973-a042-3cf1d340b1e9 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:35:27.279551 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-977008b3-3ab2-4973-a042-3cf1d340b1e9 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:27.280029 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-977008b3-3ab2-4973-a042-3cf1d340b1e9 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:27.280462 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-977008b3-3ab2-4973-a042-3cf1d340b1e9 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:27.281183 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-977008b3-3ab2-4973-a042-3cf1d340b1e9 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:27.281638 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-977008b3-3ab2-4973-a042-3cf1d340b1e9 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:27.282060 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-977008b3-3ab2-4973-a042-3cf1d340b1e9 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:27.360346 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.objects.instance [None req-977008b3-3ab2-4973-a042-3cf1d340b1e9 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lazy-loading 'services' on Instance uuid 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b {{(pid=120474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:35:27.430029 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-977008b3-3ab2-4973-a042-3cf1d340b1e9 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b/os-volume_attachments/4ed4eff9-68b0-4a97-9c99-4431ebdb34e4" status: 202 len: 0 microversion: 2.1 time: 0.161062 Sep 20 22:35:27.430624 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 544/1071] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 20 22:35:27 2022] DELETE /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b/os-volume_attachments/4ed4eff9-68b0-4a97-9c99-4431ebdb34e4 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:35:27.439448 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-245ab161-76b4-4a49-8099-9ed7bbd5badf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:27.441849 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-245ab161-76b4-4a49-8099-9ed7bbd5badf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:35:27.448750 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-245ab161-76b4-4a49-8099-9ed7bbd5badf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:27.449270 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-245ab161-76b4-4a49-8099-9ed7bbd5badf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:27.449706 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-245ab161-76b4-4a49-8099-9ed7bbd5badf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:27.450409 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-245ab161-76b4-4a49-8099-9ed7bbd5badf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:27.450894 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-245ab161-76b4-4a49-8099-9ed7bbd5badf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:27.451313 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-245ab161-76b4-4a49-8099-9ed7bbd5badf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:27.482596 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-245ab161-76b4-4a49-8099-9ed7bbd5badf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047378 Sep 20 22:35:27.483160 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 528/1072] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:35:27 2022] GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:35:28.497181 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-6ce9fed6-2505-429c-9ea6-b0937c0c1c23 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:28.499528 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-6ce9fed6-2505-429c-9ea6-b0937c0c1c23 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:35:28.506176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6ce9fed6-2505-429c-9ea6-b0937c0c1c23 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:28.506653 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6ce9fed6-2505-429c-9ea6-b0937c0c1c23 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:28.507087 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6ce9fed6-2505-429c-9ea6-b0937c0c1c23 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:28.507773 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6ce9fed6-2505-429c-9ea6-b0937c0c1c23 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:28.508226 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6ce9fed6-2505-429c-9ea6-b0937c0c1c23 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:28.508646 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-6ce9fed6-2505-429c-9ea6-b0937c0c1c23 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:28.536793 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-6ce9fed6-2505-429c-9ea6-b0937c0c1c23 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044663 Sep 20 22:35:28.537308 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 545/1073] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 20 22:35:28 2022] GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 20 22:35:28.600184 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-ef200a18-dc4e-456c-85e7-f99850b0a250 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:28.600693 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ef200a18-dc4e-456c-85e7-f99850b0a250 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:35:28.607283 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ef200a18-dc4e-456c-85e7-f99850b0a250 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:28.607854 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ef200a18-dc4e-456c-85e7-f99850b0a250 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:28.608301 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ef200a18-dc4e-456c-85e7-f99850b0a250 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:28.609020 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ef200a18-dc4e-456c-85e7-f99850b0a250 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:28.609481 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ef200a18-dc4e-456c-85e7-f99850b0a250 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:28.609907 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-ef200a18-dc4e-456c-85e7-f99850b0a250 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:28.635451 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-ef200a18-dc4e-456c-85e7-f99850b0a250 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Going to try to terminate instance {{(pid=120473) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:35:28.710884 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-ef200a18-dc4e-456c-85e7-f99850b0a250 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b" status: 204 len: 0 microversion: 2.1 time: 0.114344 Sep 20 22:35:28.714991 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 529/1074] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:35:28 2022] DELETE /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:35:28.719780 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a8109fb4-e5cd-45c3-83fd-26d4ba50f943 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:28.720388 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a8109fb4-e5cd-45c3-83fd-26d4ba50f943 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:35:28.726290 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a8109fb4-e5cd-45c3-83fd-26d4ba50f943 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:28.726765 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a8109fb4-e5cd-45c3-83fd-26d4ba50f943 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:28.727195 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a8109fb4-e5cd-45c3-83fd-26d4ba50f943 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:28.727875 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a8109fb4-e5cd-45c3-83fd-26d4ba50f943 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:28.728325 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a8109fb4-e5cd-45c3-83fd-26d4ba50f943 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:28.728742 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a8109fb4-e5cd-45c3-83fd-26d4ba50f943 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:28.857281 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a8109fb4-e5cd-45c3-83fd-26d4ba50f943 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:35:28.865459 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a8109fb4-e5cd-45c3-83fd-26d4ba50f943 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b" status: 200 len: 1682 microversion: 2.1 time: 0.149596 Sep 20 22:35:28.866033 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 546/1075] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:35:28 2022] GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:35:29.894358 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-aa5ac3be-a746-48cb-81a7-3c9e321ef53b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:29.895102 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-aa5ac3be-a746-48cb-81a7-3c9e321ef53b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:35:29.901473 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-aa5ac3be-a746-48cb-81a7-3c9e321ef53b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:29.901955 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-aa5ac3be-a746-48cb-81a7-3c9e321ef53b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:29.902392 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-aa5ac3be-a746-48cb-81a7-3c9e321ef53b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:29.903082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-aa5ac3be-a746-48cb-81a7-3c9e321ef53b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:29.903532 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-aa5ac3be-a746-48cb-81a7-3c9e321ef53b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:29.903953 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-aa5ac3be-a746-48cb-81a7-3c9e321ef53b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:30.033777 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-aa5ac3be-a746-48cb-81a7-3c9e321ef53b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:35:30.041516 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-aa5ac3be-a746-48cb-81a7-3c9e321ef53b tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b" status: 200 len: 1682 microversion: 2.1 time: 0.152218 Sep 20 22:35:30.042086 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 530/1076] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:35:29 2022] GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:35:31.065322 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-30f73f1b-1eb3-450f-a9de-bcec1c6dd704 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:31.067245 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-30f73f1b-1eb3-450f-a9de-bcec1c6dd704 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:35:31.074207 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-30f73f1b-1eb3-450f-a9de-bcec1c6dd704 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:31.075116 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-30f73f1b-1eb3-450f-a9de-bcec1c6dd704 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:31.075553 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-30f73f1b-1eb3-450f-a9de-bcec1c6dd704 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:31.076329 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-30f73f1b-1eb3-450f-a9de-bcec1c6dd704 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:31.076926 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-30f73f1b-1eb3-450f-a9de-bcec1c6dd704 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:31.077382 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-30f73f1b-1eb3-450f-a9de-bcec1c6dd704 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:31.084720 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-9ba44cb3-074c-4b2d-a1b8-0aad583b6f3a req-5348ec9c-0c97-4a03-97d3-fd439a10a549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7300b0c9-eba6-466d-b7bf-2e88bbcdd18b", "name": "network-vif-deleted", "tag": "23bb60e8-6565-4871-a176-d16b25c402c1"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:35:31.096126 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-9ba44cb3-074c-4b2d-a1b8-0aad583b6f3a req-5348ec9c-0c97-4a03-97d3-fd439a10a549 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:31.096953 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-9ba44cb3-074c-4b2d-a1b8-0aad583b6f3a req-5348ec9c-0c97-4a03-97d3-fd439a10a549 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:31.097621 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-9ba44cb3-074c-4b2d-a1b8-0aad583b6f3a req-5348ec9c-0c97-4a03-97d3-fd439a10a549 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:31.109580 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-9ba44cb3-074c-4b2d-a1b8-0aad583b6f3a req-5348ec9c-0c97-4a03-97d3-fd439a10a549 service nova] Creating event network-vif-deleted:23bb60e8-6565-4871-a176-d16b25c402c1 for instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b on hv-cinder-85827 Sep 20 22:35:31.116071 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-9ba44cb3-074c-4b2d-a1b8-0aad583b6f3a req-5348ec9c-0c97-4a03-97d3-fd439a10a549 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034815 Sep 20 22:35:31.117147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 531/1077] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:35:31.155270 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-30f73f1b-1eb3-450f-a9de-bcec1c6dd704 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af67f949fda43bf8967925f04491bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59af02f2b4984c6190870041aa020d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:35:31.168195 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-30f73f1b-1eb3-450f-a9de-bcec1c6dd704 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b" status: 200 len: 1615 microversion: 2.1 time: 0.106751 Sep 20 22:35:31.168786 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 547/1078] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:35:31 2022] GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b => generated 1615 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:35:32.193739 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b1626266-2828-4352-8bbd-265173d40b9f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:32.194443 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-b1626266-2828-4352-8bbd-265173d40b9f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:35:32.200572 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b1626266-2828-4352-8bbd-265173d40b9f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:32.201093 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b1626266-2828-4352-8bbd-265173d40b9f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:32.201533 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b1626266-2828-4352-8bbd-265173d40b9f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:32.202228 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b1626266-2828-4352-8bbd-265173d40b9f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:32.202683 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b1626266-2828-4352-8bbd-265173d40b9f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:32.203107 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-b1626266-2828-4352-8bbd-265173d40b9f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:32.217007 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-b1626266-2828-4352-8bbd-265173d40b9f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] HTTP exception thrown: Instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b could not be found. Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b1626266-2828-4352-8bbd-265173d40b9f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Request method failure captured: Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b HTTP/1.1 Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj9Aeyxjf5yMqHjDnCvmmvzhWQGzCrsBQuX_13kvowH7Ss-qoNBJb-Gfzs2nh_Wxq8YsnyXcveK6Mf9KXU9rYT6WvCgM2KCRhWvNuoaiFUsmz4N6dsiGMTW1t41Prgmfndkff0JZfffcZEBsySI2HYoAQ7I1a7TgST0Ce1eGA0Ik8Kw Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:35:32.218658 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:35:32.220384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59af02f2b4984c6190870041aa020d75", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59af02f2b4984c6190870041aa020d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:35:32.220384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:32.220384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:35:32.220384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:32.220384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:35:32.220384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:35:32.220384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:35:32.220384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 4af67f949fda43bf8967925f04491bd8 Sep 20 22:35:32.220384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:35:32.220384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:35:32.220384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b could not be found. Sep 20 22:35:32.220384 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': '7300b0c9-eba6-466d-b7bf-2e88bbcdd18b'} Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b could not be found. Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:35:32.221489 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:35:32.223089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:35:32.223089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:35:32.223089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:35:32.223089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:35:32.223089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:35:32.223089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:35:32.223089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:35:32.223089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b could not be found. Sep 20 22:35:32.223089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:32.223089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:35:32.223089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:32.223089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:32.223089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:35:32.223089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:35:32.223089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:35:32.223089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:35:32.223089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b could not be found. Sep 20 22:35:32.223089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:32.224602 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-b1626266-2828-4352-8bbd-265173d40b9f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Returning 404 to user: Instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:35:32.224602 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-b1626266-2828-4352-8bbd-265173d40b9f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b" status: 404 len: 111 microversion: 2.1 time: 0.031571 Sep 20 22:35:32.224602 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 532/1079] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:35:32 2022] GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:35:32.229428 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-72a0315e-0012-4781-9d49-ce6f0d80aba4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '.version_select at 0x7f24f68825e0>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:32.249421 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-72a0315e-0012-4781-9d49-ce6f0d80aba4 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1128653018" status: 202 len: 0 microversion: 2.1 time: 0.023780 Sep 20 22:35:32.249982 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 548/1080] 10.222.0.16 () {58 vars in 1221 bytes} [Tue Sep 20 22:35:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1128653018 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 20 22:35:33.953861 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8522edeb-a484-4869-b517-10530adae8d7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:33.954359 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8522edeb-a484-4869-b517-10530adae8d7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:35:33.961731 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8522edeb-a484-4869-b517-10530adae8d7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:33.962209 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8522edeb-a484-4869-b517-10530adae8d7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:33.962640 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8522edeb-a484-4869-b517-10530adae8d7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:33.963326 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8522edeb-a484-4869-b517-10530adae8d7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:33.963774 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8522edeb-a484-4869-b517-10530adae8d7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:33.964192 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8522edeb-a484-4869-b517-10530adae8d7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:33.977420 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-8522edeb-a484-4869-b517-10530adae8d7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] HTTP exception thrown: Instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b could not be found. Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8522edeb-a484-4869-b517-10530adae8d7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Request method failure captured: Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: DELETE /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b HTTP/1.1 Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj9Aeyxjf5yMqHjDnCvmmvzhWQGzCrsBQuX_13kvowH7Ss-qoNBJb-Gfzs2nh_Wxq8YsnyXcveK6Mf9KXU9rYT6WvCgM2KCRhWvNuoaiFUsmz4N6dsiGMTW1t41Prgmfndkff0JZfffcZEBsySI2HYoAQ7I1a7TgST0Ce1eGA0Ik8Kw Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:35:33.978952 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:35:33.980577 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59af02f2b4984c6190870041aa020d75", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59af02f2b4984c6190870041aa020d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:35:33.980577 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:33.980577 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:35:33.980577 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:33.980577 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:35:33.980577 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:35:33.980577 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:35:33.980577 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 4af67f949fda43bf8967925f04491bd8 Sep 20 22:35:33.980577 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:35:33.980577 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:35:33.980577 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b could not be found. Sep 20 22:35:33.980577 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': '7300b0c9-eba6-466d-b7bf-2e88bbcdd18b'} Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b could not be found. Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:35:33.981441 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b could not be found. Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b could not be found. Sep 20 22:35:33.982704 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:33.983959 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8522edeb-a484-4869-b517-10530adae8d7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Returning 404 to user: Instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:35:33.983959 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-8522edeb-a484-4869-b517-10530adae8d7 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b" status: 404 len: 111 microversion: 2.1 time: 0.030335 Sep 20 22:35:33.983959 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 533/1081] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:35:33 2022] DELETE /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:35:33.989650 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-bf9951ce-c848-47bd-b325-226f8a5bed08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:33.990263 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-bf9951ce-c848-47bd-b325-226f8a5bed08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:35:33.999090 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bf9951ce-c848-47bd-b325-226f8a5bed08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:33.999569 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bf9951ce-c848-47bd-b325-226f8a5bed08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:33.999998 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bf9951ce-c848-47bd-b325-226f8a5bed08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:34.000676 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bf9951ce-c848-47bd-b325-226f8a5bed08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:34.001152 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bf9951ce-c848-47bd-b325-226f8a5bed08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:34.001571 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-bf9951ce-c848-47bd-b325-226f8a5bed08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:34.014752 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-bf9951ce-c848-47bd-b325-226f8a5bed08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] HTTP exception thrown: Instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b could not be found. Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-bf9951ce-c848-47bd-b325-226f8a5bed08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Request method failure captured: Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b HTTP/1.1 Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj9Aeyxjf5yMqHjDnCvmmvzhWQGzCrsBQuX_13kvowH7Ss-qoNBJb-Gfzs2nh_Wxq8YsnyXcveK6Mf9KXU9rYT6WvCgM2KCRhWvNuoaiFUsmz4N6dsiGMTW1t41Prgmfndkff0JZfffcZEBsySI2HYoAQ7I1a7TgST0Ce1eGA0Ik8Kw Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:35:34.016343 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:35:34.018024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59af02f2b4984c6190870041aa020d75", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59af02f2b4984c6190870041aa020d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:35:34.018024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:34.018024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:35:34.018024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:34.018024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:35:34.018024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:35:34.018024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:35:34.018024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 4af67f949fda43bf8967925f04491bd8 Sep 20 22:35:34.018024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:35:34.018024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:35:34.018024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b could not be found. Sep 20 22:35:34.018024 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': '7300b0c9-eba6-466d-b7bf-2e88bbcdd18b'} Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b could not be found. Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:35:34.019016 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:35:34.020552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:35:34.020552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:35:34.020552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:35:34.020552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:35:34.020552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:35:34.020552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:35:34.020552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:35:34.020552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b could not be found. Sep 20 22:35:34.020552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:34.020552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:35:34.020552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:34.020552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:34.020552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:35:34.020552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:35:34.020552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:35:34.020552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:35:34.020552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b could not be found. Sep 20 22:35:34.020552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:34.022424 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-bf9951ce-c848-47bd-b325-226f8a5bed08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Returning 404 to user: Instance 7300b0c9-eba6-466d-b7bf-2e88bbcdd18b could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:35:34.022424 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-bf9951ce-c848-47bd-b325-226f8a5bed08 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b" status: 404 len: 111 microversion: 2.1 time: 0.032917 Sep 20 22:35:34.022424 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 549/1082] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:35:33 2022] GET /compute/v2.1/servers/7300b0c9-eba6-466d-b7bf-2e88bbcdd18b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:35:35.163433 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8859bd1c-7a92-494a-be98-e361d14e7464 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:35.163921 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8859bd1c-7a92-494a-be98-e361d14e7464 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:35:35.170390 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8859bd1c-7a92-494a-be98-e361d14e7464 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:35.170872 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8859bd1c-7a92-494a-be98-e361d14e7464 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:35.171655 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8859bd1c-7a92-494a-be98-e361d14e7464 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:35.172413 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8859bd1c-7a92-494a-be98-e361d14e7464 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:35.172870 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8859bd1c-7a92-494a-be98-e361d14e7464 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:35.173329 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8859bd1c-7a92-494a-be98-e361d14e7464 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:35.186652 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-8859bd1c-7a92-494a-be98-e361d14e7464 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] HTTP exception thrown: Instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 could not be found. Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8859bd1c-7a92-494a-be98-e361d14e7464 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Request method failure captured: Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: DELETE /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 HTTP/1.1 Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj9Aeyxjf5yMqHjDnCvmmvzhWQGzCrsBQuX_13kvowH7Ss-qoNBJb-Gfzs2nh_Wxq8YsnyXcveK6Mf9KXU9rYT6WvCgM2KCRhWvNuoaiFUsmz4N6dsiGMTW1t41Prgmfndkff0JZfffcZEBsySI2HYoAQ7I1a7TgST0Ce1eGA0Ik8Kw Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:35:35.188233 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:35:35.189906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59af02f2b4984c6190870041aa020d75", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59af02f2b4984c6190870041aa020d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:35:35.189906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:35.189906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:35:35.189906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:35.189906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:35:35.189906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:35:35.189906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:35:35.189906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 4af67f949fda43bf8967925f04491bd8 Sep 20 22:35:35.189906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:35:35.189906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:35:35.189906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 could not be found. Sep 20 22:35:35.189906 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': 'b2abce7e-ea74-4d2b-8d44-2e7889fe8971'} Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 could not be found. Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:35:35.190813 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 could not be found. Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 could not be found. Sep 20 22:35:35.192609 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.194182 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8859bd1c-7a92-494a-be98-e361d14e7464 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Returning 404 to user: Instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:35:35.194182 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-8859bd1c-7a92-494a-be98-e361d14e7464 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971" status: 404 len: 111 microversion: 2.1 time: 0.030082 Sep 20 22:35:35.194182 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 534/1083] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:35:35 2022] DELETE /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:35:35.198895 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3a47c970-092d-4099-b977-8bb9cccbfa15 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:35.199497 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-3a47c970-092d-4099-b977-8bb9cccbfa15 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: b2abce7e-ea74-4d2b-8d44-2e7889fe8971] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:35:35.205799 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3a47c970-092d-4099-b977-8bb9cccbfa15 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:35.206309 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3a47c970-092d-4099-b977-8bb9cccbfa15 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:35.208530 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3a47c970-092d-4099-b977-8bb9cccbfa15 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:35.209817 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3a47c970-092d-4099-b977-8bb9cccbfa15 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:35.209817 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3a47c970-092d-4099-b977-8bb9cccbfa15 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:35.210459 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-3a47c970-092d-4099-b977-8bb9cccbfa15 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:35.225669 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-3a47c970-092d-4099-b977-8bb9cccbfa15 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] HTTP exception thrown: Instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 could not be found. Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3a47c970-092d-4099-b977-8bb9cccbfa15 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Request method failure captured: Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 HTTP/1.1 Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj9Aeyxjf5yMqHjDnCvmmvzhWQGzCrsBQuX_13kvowH7Ss-qoNBJb-Gfzs2nh_Wxq8YsnyXcveK6Mf9KXU9rYT6WvCgM2KCRhWvNuoaiFUsmz4N6dsiGMTW1t41Prgmfndkff0JZfffcZEBsySI2HYoAQ7I1a7TgST0Ce1eGA0Ik8Kw Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:35:35.227176 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:35:35.228874 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59af02f2b4984c6190870041aa020d75", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59af02f2b4984c6190870041aa020d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:35:35.228874 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:35.228874 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:35:35.228874 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:35.228874 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:35:35.228874 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:35:35.228874 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:35:35.228874 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 4af67f949fda43bf8967925f04491bd8 Sep 20 22:35:35.228874 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:35:35.228874 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:35:35.228874 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 could not be found. Sep 20 22:35:35.228874 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': 'b2abce7e-ea74-4d2b-8d44-2e7889fe8971'} Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 could not be found. Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:35:35.229902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:35:35.231577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:35:35.231577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:35:35.231577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:35:35.231577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:35:35.231577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:35:35.231577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:35:35.231577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:35:35.231577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 could not be found. Sep 20 22:35:35.231577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.231577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:35:35.231577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.231577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:35.231577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:35:35.231577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:35:35.231577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:35:35.231577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:35:35.231577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 could not be found. Sep 20 22:35:35.231577 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.233038 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-3a47c970-092d-4099-b977-8bb9cccbfa15 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Returning 404 to user: Instance b2abce7e-ea74-4d2b-8d44-2e7889fe8971 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:35:35.233038 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-3a47c970-092d-4099-b977-8bb9cccbfa15 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971" status: 404 len: 111 microversion: 2.1 time: 0.033488 Sep 20 22:35:35.233038 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 550/1084] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:35:35 2022] GET /compute/v2.1/servers/b2abce7e-ea74-4d2b-8d44-2e7889fe8971 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:35:35.236951 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-5957c387-aefc-4048-85b8-ceb5a672c72f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:35.237475 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-5957c387-aefc-4048-85b8-ceb5a672c72f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:35:35.243320 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5957c387-aefc-4048-85b8-ceb5a672c72f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:35.243801 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5957c387-aefc-4048-85b8-ceb5a672c72f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:35.244235 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5957c387-aefc-4048-85b8-ceb5a672c72f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:35.245210 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5957c387-aefc-4048-85b8-ceb5a672c72f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:35.245666 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5957c387-aefc-4048-85b8-ceb5a672c72f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:35.246092 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-5957c387-aefc-4048-85b8-ceb5a672c72f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:35.259596 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-5957c387-aefc-4048-85b8-ceb5a672c72f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] HTTP exception thrown: Instance f8c1229b-9470-4d8f-8451-6fc1e718b652 could not be found. Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-5957c387-aefc-4048-85b8-ceb5a672c72f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Request method failure captured: Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: DELETE /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 HTTP/1.1 Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj9Aeyxjf5yMqHjDnCvmmvzhWQGzCrsBQuX_13kvowH7Ss-qoNBJb-Gfzs2nh_Wxq8YsnyXcveK6Mf9KXU9rYT6WvCgM2KCRhWvNuoaiFUsmz4N6dsiGMTW1t41Prgmfndkff0JZfffcZEBsySI2HYoAQ7I1a7TgST0Ce1eGA0Ik8Kw Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:35:35.261147 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:35:35.262732 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59af02f2b4984c6190870041aa020d75", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59af02f2b4984c6190870041aa020d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:35:35.262732 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:35.262732 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:35:35.262732 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:35.262732 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:35:35.262732 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:35:35.262732 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:35:35.262732 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 4af67f949fda43bf8967925f04491bd8 Sep 20 22:35:35.262732 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:35:35.262732 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:35:35.262732 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance f8c1229b-9470-4d8f-8451-6fc1e718b652 could not be found. Sep 20 22:35:35.262732 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': 'f8c1229b-9470-4d8f-8451-6fc1e718b652'} Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8c1229b-9470-4d8f-8451-6fc1e718b652 could not be found. Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:35:35.263606 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8c1229b-9470-4d8f-8451-6fc1e718b652 could not be found. Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8c1229b-9470-4d8f-8451-6fc1e718b652 could not be found. Sep 20 22:35:35.265130 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.266655 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-5957c387-aefc-4048-85b8-ceb5a672c72f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Returning 404 to user: Instance f8c1229b-9470-4d8f-8451-6fc1e718b652 could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:35:35.266655 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-5957c387-aefc-4048-85b8-ceb5a672c72f tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652" status: 404 len: 111 microversion: 2.1 time: 0.029407 Sep 20 22:35:35.266655 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 535/1085] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:35:35 2022] DELETE /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:35:35.271405 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-24598f21-5083-4f43-ab77-b958d246baf8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:35.272020 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-24598f21-5083-4f43-ab77-b958d246baf8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: f8c1229b-9470-4d8f-8451-6fc1e718b652] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:35:35.277892 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-24598f21-5083-4f43-ab77-b958d246baf8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:35.278373 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-24598f21-5083-4f43-ab77-b958d246baf8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:35.278807 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-24598f21-5083-4f43-ab77-b958d246baf8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:35.279495 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-24598f21-5083-4f43-ab77-b958d246baf8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:35.279949 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-24598f21-5083-4f43-ab77-b958d246baf8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:35.280372 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-24598f21-5083-4f43-ab77-b958d246baf8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:35.293313 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-24598f21-5083-4f43-ab77-b958d246baf8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] HTTP exception thrown: Instance f8c1229b-9470-4d8f-8451-6fc1e718b652 could not be found. Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-24598f21-5083-4f43-ab77-b958d246baf8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Request method failure captured: Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 HTTP/1.1 Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj9Aeyxjf5yMqHjDnCvmmvzhWQGzCrsBQuX_13kvowH7Ss-qoNBJb-Gfzs2nh_Wxq8YsnyXcveK6Mf9KXU9rYT6WvCgM2KCRhWvNuoaiFUsmz4N6dsiGMTW1t41Prgmfndkff0JZfffcZEBsySI2HYoAQ7I1a7TgST0Ce1eGA0Ik8Kw Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:35:35.294792 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:35:35.296333 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59af02f2b4984c6190870041aa020d75", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59af02f2b4984c6190870041aa020d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:35:35.296333 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:35.296333 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:35:35.296333 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:35.296333 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:35:35.296333 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:35:35.296333 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:35:35.296333 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 4af67f949fda43bf8967925f04491bd8 Sep 20 22:35:35.296333 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:35:35.296333 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:35:35.296333 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance f8c1229b-9470-4d8f-8451-6fc1e718b652 could not be found. Sep 20 22:35:35.296333 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': 'f8c1229b-9470-4d8f-8451-6fc1e718b652'} Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8c1229b-9470-4d8f-8451-6fc1e718b652 could not be found. Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:35:35.297235 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:35:35.298677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:35:35.298677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:35:35.298677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:35:35.298677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:35:35.298677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:35:35.298677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:35:35.298677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:35:35.298677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8c1229b-9470-4d8f-8451-6fc1e718b652 could not be found. Sep 20 22:35:35.298677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.298677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:35:35.298677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.298677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:35.298677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:35:35.298677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:35:35.298677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:35:35.298677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:35:35.298677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8c1229b-9470-4d8f-8451-6fc1e718b652 could not be found. Sep 20 22:35:35.298677 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:35.299931 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-24598f21-5083-4f43-ab77-b958d246baf8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Returning 404 to user: Instance f8c1229b-9470-4d8f-8451-6fc1e718b652 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:35:35.299931 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-24598f21-5083-4f43-ab77-b958d246baf8 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652" status: 404 len: 111 microversion: 2.1 time: 0.029089 Sep 20 22:35:35.299931 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 551/1086] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:35:35 2022] GET /compute/v2.1/servers/f8c1229b-9470-4d8f-8451-6fc1e718b652 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:35:36.435485 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-699daf38-cf27-4400-9f44-524558038dbf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:36.435981 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-699daf38-cf27-4400-9f44-524558038dbf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:35:36.442312 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-699daf38-cf27-4400-9f44-524558038dbf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:36.442783 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-699daf38-cf27-4400-9f44-524558038dbf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:36.443214 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-699daf38-cf27-4400-9f44-524558038dbf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:36.443896 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-699daf38-cf27-4400-9f44-524558038dbf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:36.444348 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-699daf38-cf27-4400-9f44-524558038dbf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:36.444774 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-699daf38-cf27-4400-9f44-524558038dbf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:36.460324 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-699daf38-cf27-4400-9f44-524558038dbf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] HTTP exception thrown: Instance ef067608-a015-4521-8a76-e5aeba165960 could not be found. Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-699daf38-cf27-4400-9f44-524558038dbf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Request method failure captured: Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: DELETE /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 HTTP/1.1 Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj9Aeyxjf5yMqHjDnCvmmvzhWQGzCrsBQuX_13kvowH7Ss-qoNBJb-Gfzs2nh_Wxq8YsnyXcveK6Mf9KXU9rYT6WvCgM2KCRhWvNuoaiFUsmz4N6dsiGMTW1t41Prgmfndkff0JZfffcZEBsySI2HYoAQ7I1a7TgST0Ce1eGA0Ik8Kw Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:35:36.461869 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:35:36.463548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59af02f2b4984c6190870041aa020d75", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59af02f2b4984c6190870041aa020d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:35:36.463548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:36.463548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:35:36.463548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:36.463548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:35:36.463548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:35:36.463548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:35:36.463548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: 4af67f949fda43bf8967925f04491bd8 Sep 20 22:35:36.463548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:35:36.463548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:35:36.463548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance ef067608-a015-4521-8a76-e5aeba165960 could not be found. Sep 20 22:35:36.463548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': 'ef067608-a015-4521-8a76-e5aeba165960'} Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef067608-a015-4521-8a76-e5aeba165960 could not be found. Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:35:36.464512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef067608-a015-4521-8a76-e5aeba165960 could not be found. Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef067608-a015-4521-8a76-e5aeba165960 could not be found. Sep 20 22:35:36.466082 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:35:36.467572 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-699daf38-cf27-4400-9f44-524558038dbf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Returning 404 to user: Instance ef067608-a015-4521-8a76-e5aeba165960 could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:35:36.467572 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-699daf38-cf27-4400-9f44-524558038dbf tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960" status: 404 len: 111 microversion: 2.1 time: 0.031623 Sep 20 22:35:36.467572 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 536/1087] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:35:36 2022] DELETE /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:35:36.471452 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-672c30a0-92b8-4cb6-9f4b-7c35c620bf85 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:36.472058 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-672c30a0-92b8-4cb6-9f4b-7c35c620bf85 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] [instance: ef067608-a015-4521-8a76-e5aeba165960] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:35:36.478912 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-672c30a0-92b8-4cb6-9f4b-7c35c620bf85 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:36.479384 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-672c30a0-92b8-4cb6-9f4b-7c35c620bf85 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:36.479810 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-672c30a0-92b8-4cb6-9f4b-7c35c620bf85 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:36.480486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-672c30a0-92b8-4cb6-9f4b-7c35c620bf85 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:35:36.480933 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-672c30a0-92b8-4cb6-9f4b-7c35c620bf85 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:35:36.481382 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-672c30a0-92b8-4cb6-9f4b-7c35c620bf85 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:35:36.494375 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-672c30a0-92b8-4cb6-9f4b-7c35c620bf85 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] HTTP exception thrown: Instance ef067608-a015-4521-8a76-e5aeba165960 could not be found. Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-672c30a0-92b8-4cb6-9f4b-7c35c620bf85 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Request method failure captured: Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 HTTP/1.1 Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj9Aeyxjf5yMqHjDnCvmmvzhWQGzCrsBQuX_13kvowH7Ss-qoNBJb-Gfzs2nh_Wxq8YsnyXcveK6Mf9KXU9rYT6WvCgM2KCRhWvNuoaiFUsmz4N6dsiGMTW1t41Prgmfndkff0JZfffcZEBsySI2HYoAQ7I1a7TgST0Ce1eGA0Ik8Kw Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:35:36.496108 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:35:36.497777 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59af02f2b4984c6190870041aa020d75", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59af02f2b4984c6190870041aa020d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59af02f2b4984c6190870041aa020d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:35:36.497777 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:36.497777 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 59af02f2b4984c6190870041aa020d75 Sep 20 22:35:36.497777 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1123779385 Sep 20 22:35:36.497777 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:35:36.497777 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:35:36.497777 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:35:36.497777 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: 4af67f949fda43bf8967925f04491bd8 Sep 20 22:35:36.497777 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-AttachVolumeNegativeTest-1123779385-project Sep 20 22:35:36.497777 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:35:36.497777 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance ef067608-a015-4521-8a76-e5aeba165960 could not be found. Sep 20 22:35:36.497777 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': 'ef067608-a015-4521-8a76-e5aeba165960'} Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef067608-a015-4521-8a76-e5aeba165960 could not be found. Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:35:36.498683 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:35:36.500212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:35:36.500212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:35:36.500212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:35:36.500212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:35:36.500212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:35:36.500212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:35:36.500212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:35:36.500212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef067608-a015-4521-8a76-e5aeba165960 could not be found. Sep 20 22:35:36.500212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:36.500212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:35:36.500212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:36.500212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:35:36.500212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:35:36.500212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:35:36.500212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:35:36.500212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:35:36.500212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef067608-a015-4521-8a76-e5aeba165960 could not be found. Sep 20 22:35:36.500212 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:35:36.501599 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-672c30a0-92b8-4cb6-9f4b-7c35c620bf85 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] Returning 404 to user: Instance ef067608-a015-4521-8a76-e5aeba165960 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:35:36.501599 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-672c30a0-92b8-4cb6-9f4b-7c35c620bf85 tempest-AttachVolumeNegativeTest-1123779385 tempest-AttachVolumeNegativeTest-1123779385-project] 10.222.0.16 "GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960" status: 404 len: 111 microversion: 2.1 time: 0.029817 Sep 20 22:35:36.501599 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 552/1088] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:35:36 2022] GET /compute/v2.1/servers/ef067608-a015-4521-8a76-e5aeba165960 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:35:42.316998 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-daed143c-9583-49c8-baf7-d7a2f9f27f71 tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] Calling method '.version_select at 0x7f24f673a940>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:42.364803 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-daed143c-9583-49c8-baf7-d7a2f9f27f71 tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3a14865d-99f1-4c84-8e38-36c5a5dd6f6c" status: 200 len: 351 microversion: 2.1 time: 0.051654 Sep 20 22:35:42.365510 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 537/1089] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 20 22:35:42 2022] GET /compute/v2.1/os-volumes/3a14865d-99f1-4c84-8e38-36c5a5dd6f6c => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:35:43.709149 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-859ebcb9-8daa-45ab-bdb4-265864a5165d tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] Calling method '.version_select at 0x7f24f698d1f0>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:43.755337 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-859ebcb9-8daa-45ab-bdb4-265864a5165d tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d94111a6-4404-4fb0-9e6c-55e28664e9cb" status: 200 len: 350 microversion: 2.1 time: 0.050447 Sep 20 22:35:43.755897 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 553/1090] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 20 22:35:43 2022] GET /compute/v2.1/os-volumes/d94111a6-4404-4fb0-9e6c-55e28664e9cb => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:35:45.087867 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-7d2f68f3-e336-4dad-8705-74ffe44d334e tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] Calling method '.version_select at 0x7f24f67a4a60>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:45.134519 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-7d2f68f3-e336-4dad-8705-74ffe44d334e tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a24a01ea-69d5-4f50-b540-83c6c41d6fce" status: 200 len: 351 microversion: 2.1 time: 0.050813 Sep 20 22:35:45.135078 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 538/1091] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 20 22:35:45 2022] GET /compute/v2.1/os-volumes/a24a01ea-69d5-4f50-b540-83c6c41d6fce => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:35:45.148879 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-918ce6d9-e33c-416f-9214-c60a4a3a979a tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] Calling method '.version_select at 0x7f24f763c670>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:45.229159 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-918ce6d9-e33c-416f-9214-c60a4a3a979a tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084862 Sep 20 22:35:45.229725 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 554/1092] 10.222.0.16 () {58 vars in 1134 bytes} [Tue Sep 20 22:35:45 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:35:45.243792 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-5f54e39e-6a66-42d0-a7c5-016674fa7c86 tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] Calling method '.version_select at 0x7f24f69d2670>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:45.325653 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-5f54e39e-6a66-42d0-a7c5-016674fa7c86 tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085510 Sep 20 22:35:45.326216 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 539/1093] 10.222.0.16 () {58 vars in 1149 bytes} [Tue Sep 20 22:35:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:35:45.340303 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-775b0949-1276-472c-99bb-9d9b7d6affa3 tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] Calling method '.version_select at 0x7f24f6968d30>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:45.421088 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-775b0949-1276-472c-99bb-9d9b7d6affa3 tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084361 Sep 20 22:35:45.421667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 555/1094] 10.222.0.16 () {58 vars in 1134 bytes} [Tue Sep 20 22:35:45 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:35:45.434937 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-16534716-ebdc-4c0d-b8ff-844de5e327fe tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] Calling method '.version_select at 0x7f24f6849670>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:45.516401 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-16534716-ebdc-4c0d-b8ff-844de5e327fe tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085181 Sep 20 22:35:45.516987 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 540/1095] 10.222.0.16 () {58 vars in 1167 bytes} [Tue Sep 20 22:35:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:35:45.531302 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-219f5419-13c9-4fff-ad31-0a69cbeeb581 tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] Calling method '.version_select at 0x7f24f6962af0>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:45.781512 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-219f5419-13c9-4fff-ad31-0a69cbeeb581 tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.253839 Sep 20 22:35:45.782083 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 556/1096] 10.222.0.16 () {58 vars in 1170 bytes} [Tue Sep 20 22:35:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 20 22:35:45.795693 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-a3b2cb46-88a2-4ca5-8dc6-245b46cf1714 tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] Calling method '.version_select at 0x7f24f66baca0>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:45.876839 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-a3b2cb46-88a2-4ca5-8dc6-245b46cf1714 tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084823 Sep 20 22:35:45.877447 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 541/1097] 10.222.0.16 () {58 vars in 1155 bytes} [Tue Sep 20 22:35:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:35:45.891470 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-d2112914-3d8c-48e1-958d-f0346a1bfc06 tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] Calling method '.version_select at 0x7f24f668d280>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:45.978318 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-d2112914-3d8c-48e1-958d-f0346a1bfc06 tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090622 Sep 20 22:35:45.978889 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 557/1098] 10.222.0.16 () {58 vars in 1188 bytes} [Tue Sep 20 22:35:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:35:45.993169 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-179bdbf4-bf25-42c8-8181-bf8f4d7c3293 tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] Calling method '.version_select at 0x7f24f69d2ee0>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:35:46.076615 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-179bdbf4-bf25-42c8-8181-bf8f4d7c3293 tempest-VolumesTestJSON-1386199133 tempest-VolumesTestJSON-1386199133-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087091 Sep 20 22:35:46.077212 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 542/1099] 10.222.0.16 () {58 vars in 1155 bytes} [Tue Sep 20 22:35:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:36:14.509348 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:36:14.512005 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:36:14.513113 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG dbcounter [-] [120473] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:36:14.513583 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG dbcounter [-] [120474] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=1 {{(pid=120474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:36:14.519882 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-c7ea343d-0f0c-433f-8cef-b156fff0d880 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:36:14.520412 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-c7ea343d-0f0c-433f-8cef-b156fff0d880 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:36:14.527160 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c7ea343d-0f0c-433f-8cef-b156fff0d880 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:14.527656 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c7ea343d-0f0c-433f-8cef-b156fff0d880 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:14.528131 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c7ea343d-0f0c-433f-8cef-b156fff0d880 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:14.529050 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c7ea343d-0f0c-433f-8cef-b156fff0d880 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:14.529604 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c7ea343d-0f0c-433f-8cef-b156fff0d880 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:14.530270 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-c7ea343d-0f0c-433f-8cef-b156fff0d880 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:14.560043 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-c7ea343d-0f0c-433f-8cef-b156fff0d880 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Going to try to terminate instance {{(pid=120474) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:36:14.647395 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-c7ea343d-0f0c-433f-8cef-b156fff0d880 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 204 len: 0 microversion: 2.1 time: 0.138506 Sep 20 22:36:14.648499 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 558/1100] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:36:14 2022] DELETE /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:36:14.657938 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-9a287048-6d62-42de-88b0-3fe55a67661c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:36:14.658671 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-9a287048-6d62-42de-88b0-3fe55a67661c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:36:14.666064 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9a287048-6d62-42de-88b0-3fe55a67661c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:14.666563 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9a287048-6d62-42de-88b0-3fe55a67661c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:14.667005 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9a287048-6d62-42de-88b0-3fe55a67661c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:14.667712 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9a287048-6d62-42de-88b0-3fe55a67661c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:14.668172 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9a287048-6d62-42de-88b0-3fe55a67661c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:14.668601 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-9a287048-6d62-42de-88b0-3fe55a67661c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:14.735552 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [req-708f56cb-5d79-4f15-9d42-068753084b15 req-4fd9e929-a36e-4373-a3dc-2bb69f9645e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e774edc1-1d20-4540-b590-2e5a67ab17c7", "tag": "84111c91-8792-4d28-85ba-d23ba9e2ef0a"}]} {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:36:14.748540 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-708f56cb-5d79-4f15-9d42-068753084b15 req-4fd9e929-a36e-4373-a3dc-2bb69f9645e4 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:14.749083 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-708f56cb-5d79-4f15-9d42-068753084b15 req-4fd9e929-a36e-4373-a3dc-2bb69f9645e4 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:14.749675 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [req-708f56cb-5d79-4f15-9d42-068753084b15 req-4fd9e929-a36e-4373-a3dc-2bb69f9645e4 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:14.763629 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.compute.server_external_events [req-708f56cb-5d79-4f15-9d42-068753084b15 req-4fd9e929-a36e-4373-a3dc-2bb69f9645e4 service nova] Creating event network-changed:84111c91-8792-4d28-85ba-d23ba9e2ef0a for instance e774edc1-1d20-4540-b590-2e5a67ab17c7 on hv-cinder-85827 Sep 20 22:36:14.770969 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [req-708f56cb-5d79-4f15-9d42-068753084b15 req-4fd9e929-a36e-4373-a3dc-2bb69f9645e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259641 Sep 20 22:36:14.771780 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 543/1101] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:36:14.834293 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-9a287048-6d62-42de-88b0-3fe55a67661c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:36:14.842076 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-9a287048-6d62-42de-88b0-3fe55a67661c tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1577 microversion: 2.1 time: 0.189363 Sep 20 22:36:14.842642 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 559/1102] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:36:14 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1577 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 20 22:36:15.866474 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-0c24270d-016f-4197-9410-af2df1a08b0b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:36:15.867895 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-0c24270d-016f-4197-9410-af2df1a08b0b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:36:15.874712 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0c24270d-016f-4197-9410-af2df1a08b0b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:15.875265 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0c24270d-016f-4197-9410-af2df1a08b0b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:15.875765 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0c24270d-016f-4197-9410-af2df1a08b0b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:15.876529 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0c24270d-016f-4197-9410-af2df1a08b0b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:15.877089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0c24270d-016f-4197-9410-af2df1a08b0b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:15.877512 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-0c24270d-016f-4197-9410-af2df1a08b0b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:16.005711 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-0c24270d-016f-4197-9410-af2df1a08b0b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:36:16.013453 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-0c24270d-016f-4197-9410-af2df1a08b0b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1577 microversion: 2.1 time: 0.151861 Sep 20 22:36:16.014052 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 544/1103] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:36:15 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:36:16.785645 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-011a4cd0-892b-4f84-85d6-b0fd9a25e653 req-0e8976e7-5a06-4167-a1e2-e7d2d335b451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e774edc1-1d20-4540-b590-2e5a67ab17c7", "name": "network-vif-deleted", "tag": "84111c91-8792-4d28-85ba-d23ba9e2ef0a"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:36:16.795599 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-011a4cd0-892b-4f84-85d6-b0fd9a25e653 req-0e8976e7-5a06-4167-a1e2-e7d2d335b451 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:16.796084 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-011a4cd0-892b-4f84-85d6-b0fd9a25e653 req-0e8976e7-5a06-4167-a1e2-e7d2d335b451 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:16.796562 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-011a4cd0-892b-4f84-85d6-b0fd9a25e653 req-0e8976e7-5a06-4167-a1e2-e7d2d335b451 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:16.808332 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-011a4cd0-892b-4f84-85d6-b0fd9a25e653 req-0e8976e7-5a06-4167-a1e2-e7d2d335b451 service nova] Creating event network-vif-deleted:84111c91-8792-4d28-85ba-d23ba9e2ef0a for instance e774edc1-1d20-4540-b590-2e5a67ab17c7 on hv-cinder-85827 Sep 20 22:36:16.813285 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-011a4cd0-892b-4f84-85d6-b0fd9a25e653 req-0e8976e7-5a06-4167-a1e2-e7d2d335b451 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031265 Sep 20 22:36:16.813987 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 560/1104] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:36:17.036752 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-3c8c17e5-c2f2-4bd0-b6ae-571be275d743 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:36:17.037392 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-3c8c17e5-c2f2-4bd0-b6ae-571be275d743 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:36:17.043847 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3c8c17e5-c2f2-4bd0-b6ae-571be275d743 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:17.044333 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3c8c17e5-c2f2-4bd0-b6ae-571be275d743 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:17.044773 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3c8c17e5-c2f2-4bd0-b6ae-571be275d743 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:17.045497 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3c8c17e5-c2f2-4bd0-b6ae-571be275d743 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:17.045978 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3c8c17e5-c2f2-4bd0-b6ae-571be275d743 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:17.046403 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3c8c17e5-c2f2-4bd0-b6ae-571be275d743 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:17.083321 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3c8c17e5-c2f2-4bd0-b6ae-571be275d743 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:17.083754 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3c8c17e5-c2f2-4bd0-b6ae-571be275d743 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:17.084192 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-3c8c17e5-c2f2-4bd0-b6ae-571be275d743 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:17.084638 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-3c8c17e5-c2f2-4bd0-b6ae-571be275d743 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lazy-loading 'fault' on Instance uuid e774edc1-1d20-4540-b590-2e5a67ab17c7 {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:36:17.125485 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-3c8c17e5-c2f2-4bd0-b6ae-571be275d743 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:36:17.133478 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-3c8c17e5-c2f2-4bd0-b6ae-571be275d743 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 200 len: 1229 microversion: 2.1 time: 0.101187 Sep 20 22:36:17.134052 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 545/1105] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:36:17 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 1229 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:36:18.157430 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-045ed489-9227-40b4-aa43-335c3b3a5ecc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:36:18.158154 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-045ed489-9227-40b4-aa43-335c3b3a5ecc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: e774edc1-1d20-4540-b590-2e5a67ab17c7] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:36:18.164353 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-045ed489-9227-40b4-aa43-335c3b3a5ecc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:18.164826 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-045ed489-9227-40b4-aa43-335c3b3a5ecc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:18.165282 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-045ed489-9227-40b4-aa43-335c3b3a5ecc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:18.165957 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-045ed489-9227-40b4-aa43-335c3b3a5ecc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:18.166402 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-045ed489-9227-40b4-aa43-335c3b3a5ecc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:18.166818 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-045ed489-9227-40b4-aa43-335c3b3a5ecc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:18.181612 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-045ed489-9227-40b4-aa43-335c3b3a5ecc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] HTTP exception thrown: Instance e774edc1-1d20-4540-b590-2e5a67ab17c7 could not be found. Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-045ed489-9227-40b4-aa43-335c3b3a5ecc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Request method failure captured: Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 HTTP/1.1 Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj7DhnCl26lGwWR9DBtjb-oo553Ik-4pWp8N4Xmdq2pT6zAlEsSu1msv05dIUnCV2oYTR9ZkcsnL736mrZ6I_zJ2ZklLiY4p_TfysEaCHqitrYy4DSZ2WRkO_ehACFl_0mlrNJ5KC8kQQ2p9RHKVWvIlPUeNqTsdh0WyeBVYhlxoIv4 Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 42019663de764ee490940ccca9300b0f Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-TestVolumeBootPattern-1539651322 Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:36:18.183190 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:36:18.184936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42019663de764ee490940ccca9300b0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42019663de764ee490940ccca9300b0f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42019663de764ee490940ccca9300b0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42019663de764ee490940ccca9300b0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:36:18.184936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-TestVolumeBootPattern-1539651322 Sep 20 22:36:18.184936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 42019663de764ee490940ccca9300b0f Sep 20 22:36:18.184936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-TestVolumeBootPattern-1539651322 Sep 20 22:36:18.184936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-TestVolumeBootPattern-1539651322-project Sep 20 22:36:18.184936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:36:18.184936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:36:18.184936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: b1b69806fd5f4885a824a58fa1d4432c Sep 20 22:36:18.184936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-TestVolumeBootPattern-1539651322-project Sep 20 22:36:18.184936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:36:18.184936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance e774edc1-1d20-4540-b590-2e5a67ab17c7 could not be found. Sep 20 22:36:18.184936 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': 'e774edc1-1d20-4540-b590-2e5a67ab17c7'} Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e774edc1-1d20-4540-b590-2e5a67ab17c7 could not be found. Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:36:18.185974 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:36:18.187748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:36:18.187748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:36:18.187748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:36:18.187748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:36:18.187748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:36:18.187748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:36:18.187748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:36:18.187748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e774edc1-1d20-4540-b590-2e5a67ab17c7 could not be found. Sep 20 22:36:18.187748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:36:18.187748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:36:18.187748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:36:18.187748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:36:18.187748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:36:18.187748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:36:18.187748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:36:18.187748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:36:18.187748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e774edc1-1d20-4540-b590-2e5a67ab17c7 could not be found. Sep 20 22:36:18.187748 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:36:18.189332 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-045ed489-9227-40b4-aa43-335c3b3a5ecc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Returning 404 to user: Instance e774edc1-1d20-4540-b590-2e5a67ab17c7 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:36:18.189332 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-045ed489-9227-40b4-aa43-335c3b3a5ecc tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7" status: 404 len: 111 microversion: 2.1 time: 0.031816 Sep 20 22:36:18.189332 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 561/1106] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:36:18 2022] GET /compute/v2.1/servers/e774edc1-1d20-4540-b590-2e5a67ab17c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:36:21.207645 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-4ff5ec44-cb39-4880-bbcd-66f90dc3c100 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:36:21.208241 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-4ff5ec44-cb39-4880-bbcd-66f90dc3c100 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:36:21.210146 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-44bd8315-bdb9-44d6-81df-d8ef3058b384 req-80008e44-c306-4983-ab32-10aabbb2a0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0da41d34-e3ba-4805-8662-2461d3b48ec0", "tag": "a06a3906-0bdb-4e5e-a8ce-e043710e1f6b"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:36:21.215299 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ff5ec44-cb39-4880-bbcd-66f90dc3c100 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:21.215791 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ff5ec44-cb39-4880-bbcd-66f90dc3c100 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:21.216231 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ff5ec44-cb39-4880-bbcd-66f90dc3c100 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:21.216931 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ff5ec44-cb39-4880-bbcd-66f90dc3c100 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:21.217657 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ff5ec44-cb39-4880-bbcd-66f90dc3c100 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:21.218083 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-4ff5ec44-cb39-4880-bbcd-66f90dc3c100 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:21.220531 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-44bd8315-bdb9-44d6-81df-d8ef3058b384 req-80008e44-c306-4983-ab32-10aabbb2a0c1 service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:21.221305 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-44bd8315-bdb9-44d6-81df-d8ef3058b384 req-80008e44-c306-4983-ab32-10aabbb2a0c1 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:21.221797 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-44bd8315-bdb9-44d6-81df-d8ef3058b384 req-80008e44-c306-4983-ab32-10aabbb2a0c1 service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:21.233001 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-44bd8315-bdb9-44d6-81df-d8ef3058b384 req-80008e44-c306-4983-ab32-10aabbb2a0c1 service nova] Creating event network-changed:a06a3906-0bdb-4e5e-a8ce-e043710e1f6b for instance 0da41d34-e3ba-4805-8662-2461d3b48ec0 on hv-cinder-85827 Sep 20 22:36:21.239040 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-44bd8315-bdb9-44d6-81df-d8ef3058b384 req-80008e44-c306-4983-ab32-10aabbb2a0c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032163 Sep 20 22:36:21.239913 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 562/1107] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:36:21.246028 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-4ff5ec44-cb39-4880-bbcd-66f90dc3c100 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Going to try to terminate instance {{(pid=120473) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 20 22:36:21.329907 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-4ff5ec44-cb39-4880-bbcd-66f90dc3c100 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 204 len: 0 microversion: 2.1 time: 0.125975 Sep 20 22:36:21.330818 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 546/1108] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:36:21 2022] DELETE /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 20 22:36:21.345888 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-a97a81b8-3180-40f0-ab6a-0bf581e5a16a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:36:21.349142 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-a97a81b8-3180-40f0-ab6a-0bf581e5a16a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:36:21.357004 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a97a81b8-3180-40f0-ab6a-0bf581e5a16a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:21.357487 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a97a81b8-3180-40f0-ab6a-0bf581e5a16a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:21.357919 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a97a81b8-3180-40f0-ab6a-0bf581e5a16a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:21.358617 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a97a81b8-3180-40f0-ab6a-0bf581e5a16a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:21.359067 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a97a81b8-3180-40f0-ab6a-0bf581e5a16a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:21.359480 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-a97a81b8-3180-40f0-ab6a-0bf581e5a16a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:21.494582 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.policy [None req-a97a81b8-3180-40f0-ab6a-0bf581e5a16a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120474) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:36:21.502722 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-a97a81b8-3180-40f0-ab6a-0bf581e5a16a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1578 microversion: 2.1 time: 0.165536 Sep 20 22:36:21.503294 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 563/1109] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:36:21 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:36:22.527223 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-9d4df040-4fc9-490d-bdd4-3782e330c95a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:36:22.527934 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-9d4df040-4fc9-490d-bdd4-3782e330c95a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:36:22.534294 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9d4df040-4fc9-490d-bdd4-3782e330c95a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:22.534784 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9d4df040-4fc9-490d-bdd4-3782e330c95a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:22.535225 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9d4df040-4fc9-490d-bdd4-3782e330c95a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:22.535923 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9d4df040-4fc9-490d-bdd4-3782e330c95a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:22.536377 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9d4df040-4fc9-490d-bdd4-3782e330c95a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:22.536801 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-9d4df040-4fc9-490d-bdd4-3782e330c95a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:22.678138 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-9d4df040-4fc9-490d-bdd4-3782e330c95a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:36:22.685956 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-9d4df040-4fc9-490d-bdd4-3782e330c95a tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1578 microversion: 2.1 time: 0.163020 Sep 20 22:36:22.686548 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 547/1110] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:36:22 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:36:23.213436 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [req-aa941a9b-24c9-4aea-a353-3a24ece19669 req-bea5f662-f548-4aa1-8c51-565acd9395da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da41d34-e3ba-4805-8662-2461d3b48ec0", "name": "network-vif-deleted", "tag": "a06a3906-0bdb-4e5e-a8ce-e043710e1f6b"}]} {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 20 22:36:23.223643 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-aa941a9b-24c9-4aea-a353-3a24ece19669 req-bea5f662-f548-4aa1-8c51-565acd9395da service nova] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:23.224121 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-aa941a9b-24c9-4aea-a353-3a24ece19669 req-bea5f662-f548-4aa1-8c51-565acd9395da service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:23.224552 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [req-aa941a9b-24c9-4aea-a353-3a24ece19669 req-bea5f662-f548-4aa1-8c51-565acd9395da service nova] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:23.235867 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.compute.server_external_events [req-aa941a9b-24c9-4aea-a353-3a24ece19669 req-bea5f662-f548-4aa1-8c51-565acd9395da service nova] Creating event network-vif-deleted:a06a3906-0bdb-4e5e-a8ce-e043710e1f6b for instance 0da41d34-e3ba-4805-8662-2461d3b48ec0 on hv-cinder-85827 Sep 20 22:36:23.241338 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [req-aa941a9b-24c9-4aea-a353-3a24ece19669 req-bea5f662-f548-4aa1-8c51-565acd9395da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031570 Sep 20 22:36:23.242006 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 564/1111] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 20 22:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 20 22:36:23.709145 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-51c4ddb6-67fa-493a-87c1-dca0ef5f4174 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:36:23.709759 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-51c4ddb6-67fa-493a-87c1-dca0ef5f4174 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:36:23.716089 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-51c4ddb6-67fa-493a-87c1-dca0ef5f4174 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:23.716565 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-51c4ddb6-67fa-493a-87c1-dca0ef5f4174 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:23.717012 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-51c4ddb6-67fa-493a-87c1-dca0ef5f4174 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:23.717698 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-51c4ddb6-67fa-493a-87c1-dca0ef5f4174 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:23.718145 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-51c4ddb6-67fa-493a-87c1-dca0ef5f4174 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:23.718562 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-51c4ddb6-67fa-493a-87c1-dca0ef5f4174 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:23.749755 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-51c4ddb6-67fa-493a-87c1-dca0ef5f4174 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:23.750158 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-51c4ddb6-67fa-493a-87c1-dca0ef5f4174 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:23.750587 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-51c4ddb6-67fa-493a-87c1-dca0ef5f4174 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:23.751025 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.objects.instance [None req-51c4ddb6-67fa-493a-87c1-dca0ef5f4174 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lazy-loading 'fault' on Instance uuid 0da41d34-e3ba-4805-8662-2461d3b48ec0 {{(pid=120473) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 20 22:36:23.794830 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.policy [None req-51c4ddb6-67fa-493a-87c1-dca0ef5f4174 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b69806fd5f4885a824a58fa1d4432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42019663de764ee490940ccca9300b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120473) authorize /opt/stack/nova/nova/policy.py:199}} Sep 20 22:36:23.802629 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-51c4ddb6-67fa-493a-87c1-dca0ef5f4174 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 200 len: 1230 microversion: 2.1 time: 0.097849 Sep 20 22:36:23.803424 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 548/1112] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:36:23 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 20 22:36:24.827618 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5df4fa03-e4e6-4f3b-a60b-a9920eb78c10 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:36:24.828298 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-5df4fa03-e4e6-4f3b-a60b-a9920eb78c10 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 0da41d34-e3ba-4805-8662-2461d3b48ec0] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:36:24.834902 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5df4fa03-e4e6-4f3b-a60b-a9920eb78c10 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:24.835381 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5df4fa03-e4e6-4f3b-a60b-a9920eb78c10 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:24.835811 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5df4fa03-e4e6-4f3b-a60b-a9920eb78c10 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:24.836493 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5df4fa03-e4e6-4f3b-a60b-a9920eb78c10 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:24.836947 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5df4fa03-e4e6-4f3b-a60b-a9920eb78c10 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:24.837397 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-5df4fa03-e4e6-4f3b-a60b-a9920eb78c10 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:24.850906 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-5df4fa03-e4e6-4f3b-a60b-a9920eb78c10 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] HTTP exception thrown: Instance 0da41d34-e3ba-4805-8662-2461d3b48ec0 could not be found. Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5df4fa03-e4e6-4f3b-a60b-a9920eb78c10 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Request method failure captured: Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 HTTP/1.1 Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj7DhnCl26lGwWR9DBtjb-oo553Ik-4pWp8N4Xmdq2pT6zAlEsSu1msv05dIUnCV2oYTR9ZkcsnL736mrZ6I_zJ2ZklLiY4p_TfysEaCHqitrYy4DSZ2WRkO_ehACFl_0mlrNJ5KC8kQQ2p9RHKVWvIlPUeNqTsdh0WyeBVYhlxoIv4 Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 42019663de764ee490940ccca9300b0f Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-TestVolumeBootPattern-1539651322 Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:36:24.852479 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:36:24.854492 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42019663de764ee490940ccca9300b0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42019663de764ee490940ccca9300b0f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42019663de764ee490940ccca9300b0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42019663de764ee490940ccca9300b0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:36:24.854492 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-TestVolumeBootPattern-1539651322 Sep 20 22:36:24.854492 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 42019663de764ee490940ccca9300b0f Sep 20 22:36:24.854492 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-TestVolumeBootPattern-1539651322 Sep 20 22:36:24.854492 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-TestVolumeBootPattern-1539651322-project Sep 20 22:36:24.854492 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:36:24.854492 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:36:24.854492 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: b1b69806fd5f4885a824a58fa1d4432c Sep 20 22:36:24.854492 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-TestVolumeBootPattern-1539651322-project Sep 20 22:36:24.854492 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:36:24.854492 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance 0da41d34-e3ba-4805-8662-2461d3b48ec0 could not be found. Sep 20 22:36:24.854492 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': '0da41d34-e3ba-4805-8662-2461d3b48ec0'} Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0da41d34-e3ba-4805-8662-2461d3b48ec0 could not be found. Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:36:24.855486 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:36:24.857102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:36:24.857102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:36:24.857102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:36:24.857102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:36:24.857102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:36:24.857102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:36:24.857102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:36:24.857102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0da41d34-e3ba-4805-8662-2461d3b48ec0 could not be found. Sep 20 22:36:24.857102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:36:24.857102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:36:24.857102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:36:24.857102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:36:24.857102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:36:24.857102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:36:24.857102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:36:24.857102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:36:24.857102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0da41d34-e3ba-4805-8662-2461d3b48ec0 could not be found. Sep 20 22:36:24.857102 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:36:24.858657 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-5df4fa03-e4e6-4f3b-a60b-a9920eb78c10 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Returning 404 to user: Instance 0da41d34-e3ba-4805-8662-2461d3b48ec0 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:36:24.858657 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-5df4fa03-e4e6-4f3b-a60b-a9920eb78c10 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0" status: 404 len: 111 microversion: 2.1 time: 0.031116 Sep 20 22:36:24.858657 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 565/1113] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:36:24 2022] GET /compute/v2.1/servers/0da41d34-e3ba-4805-8662-2461d3b48ec0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:36:25.283168 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8277f712-227c-4cf0-a836-22fcd7ac9bcd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:36:25.283667 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.compute.api [None req-8277f712-227c-4cf0-a836-22fcd7ac9bcd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120473) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:36:25.290080 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8277f712-227c-4cf0-a836-22fcd7ac9bcd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:25.290563 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8277f712-227c-4cf0-a836-22fcd7ac9bcd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:25.290993 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8277f712-227c-4cf0-a836-22fcd7ac9bcd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:25.291677 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8277f712-227c-4cf0-a836-22fcd7ac9bcd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:25.292128 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8277f712-227c-4cf0-a836-22fcd7ac9bcd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:25.292555 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG oslo_concurrency.lockutils [None req-8277f712-227c-4cf0-a836-22fcd7ac9bcd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:25.305561 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.wsgi [None req-8277f712-227c-4cf0-a836-22fcd7ac9bcd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] HTTP exception thrown: Instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 could not be found. Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8277f712-227c-4cf0-a836-22fcd7ac9bcd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Request method failure captured: Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: request: DELETE /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 HTTP/1.1 Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept: application/json Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Accept-Encoding: identity Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Connection: close Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Length: 0 Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Content-Type: application/json Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Host: 10.222.0.16 Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: Openstack-System-Scope: None Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: User-Agent: python-urllib3/1.26.12 Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Auth-Token: gAAAAABjKj7DhnCl26lGwWR9DBtjb-oo553Ik-4pWp8N4Xmdq2pT6zAlEsSu1msv05dIUnCV2oYTR9ZkcsnL736mrZ6I_zJ2ZklLiY4p_TfysEaCHqitrYy4DSZ2WRkO_ehACFl_0mlrNJ5KC8kQQ2p9RHKVWvIlPUeNqTsdh0WyeBVYhlxoIv4 Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Id: None Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Domain-Name: None Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Identity-Status: Confirmed Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Is-Admin-Project: True Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Id: default Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Domain-Name: Default Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Id: 42019663de764ee490940ccca9300b0f Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Project-Name: tempest-TestVolumeBootPattern-1539651322 Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Role: reader,member Sep 20 22:36:25.307122 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Roles: reader,member Sep 20 22:36:25.308872 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42019663de764ee490940ccca9300b0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42019663de764ee490940ccca9300b0f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42019663de764ee490940ccca9300b0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42019663de764ee490940ccca9300b0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:36:25.308872 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant: tempest-TestVolumeBootPattern-1539651322 Sep 20 22:36:25.308872 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Id: 42019663de764ee490940ccca9300b0f Sep 20 22:36:25.308872 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-Tenant-Name: tempest-TestVolumeBootPattern-1539651322 Sep 20 22:36:25.308872 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User: tempest-TestVolumeBootPattern-1539651322-project Sep 20 22:36:25.308872 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Id: default Sep 20 22:36:25.308872 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Domain-Name: Default Sep 20 22:36:25.308872 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Id: b1b69806fd5f4885a824a58fa1d4432c Sep 20 22:36:25.308872 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: X-User-Name: tempest-TestVolumeBootPattern-1539651322-project Sep 20 22:36:25.308872 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: method: > Sep 20 22:36:25.308872 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: exception: Instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 could not be found. Sep 20 22:36:25.308872 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: action_args: {'id': '9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1'} Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 could not be found. Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:36:25.309796 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 could not be found. Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 could not be found. Sep 20 22:36:25.311178 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: ERROR nova.api.openstack.wsgi Sep 20 22:36:25.312674 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-8277f712-227c-4cf0-a836-22fcd7ac9bcd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Returning 404 to user: Instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 could not be found. {{(pid=120473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:36:25.312674 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-8277f712-227c-4cf0-a836-22fcd7ac9bcd tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 404 len: 111 microversion: 2.1 time: 0.029196 Sep 20 22:36:25.312674 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 549/1114] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 20 22:36:25 2022] DELETE /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:36:25.317480 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-04d08be0-795d-4bb6-a43f-2c681afb2f17 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '>' {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:36:25.318127 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.compute.api [None req-04d08be0-795d-4bb6-a43f-2c681afb2f17 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] [instance: 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1] Fetching instance by UUID {{(pid=120474) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 20 22:36:25.324068 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-04d08be0-795d-4bb6-a43f-2c681afb2f17 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:25.324572 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-04d08be0-795d-4bb6-a43f-2c681afb2f17 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:25.325027 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-04d08be0-795d-4bb6-a43f-2c681afb2f17 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:25.325721 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-04d08be0-795d-4bb6-a43f-2c681afb2f17 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Acquiring lock "aaca181d-8f33-4223-a648-2988e81860b3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 20 22:36:25.326187 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-04d08be0-795d-4bb6-a43f-2c681afb2f17 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 20 22:36:25.326610 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG oslo_concurrency.lockutils [None req-04d08be0-795d-4bb6-a43f-2c681afb2f17 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Lock "aaca181d-8f33-4223-a648-2988e81860b3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 20 22:36:25.340668 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.wsgi [None req-04d08be0-795d-4bb6-a43f-2c681afb2f17 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] HTTP exception thrown: Instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 could not be found. Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-04d08be0-795d-4bb6-a43f-2c681afb2f17 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Request method failure captured: Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: request: GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 HTTP/1.1 Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept: application/json Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Accept-Encoding: identity Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Connection: close Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Length: 0 Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Content-Type: application/json Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Host: 10.222.0.16 Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: Openstack-System-Scope: None Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: User-Agent: python-urllib3/1.26.12 Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Auth-Token: gAAAAABjKj7DhnCl26lGwWR9DBtjb-oo553Ik-4pWp8N4Xmdq2pT6zAlEsSu1msv05dIUnCV2oYTR9ZkcsnL736mrZ6I_zJ2ZklLiY4p_TfysEaCHqitrYy4DSZ2WRkO_ehACFl_0mlrNJ5KC8kQQ2p9RHKVWvIlPUeNqTsdh0WyeBVYhlxoIv4 Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Id: None Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Domain-Name: None Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Identity-Status: Confirmed Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Is-Admin-Project: True Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Id: default Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Domain-Name: Default Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Id: 42019663de764ee490940ccca9300b0f Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Project-Name: tempest-TestVolumeBootPattern-1539651322 Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Role: reader,member Sep 20 22:36:25.342213 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Roles: reader,member Sep 20 22:36:25.344026 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42019663de764ee490940ccca9300b0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42019663de764ee490940ccca9300b0f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42019663de764ee490940ccca9300b0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42019663de764ee490940ccca9300b0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Sep 20 22:36:25.344026 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant: tempest-TestVolumeBootPattern-1539651322 Sep 20 22:36:25.344026 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Id: 42019663de764ee490940ccca9300b0f Sep 20 22:36:25.344026 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-Tenant-Name: tempest-TestVolumeBootPattern-1539651322 Sep 20 22:36:25.344026 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User: tempest-TestVolumeBootPattern-1539651322-project Sep 20 22:36:25.344026 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Id: default Sep 20 22:36:25.344026 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Domain-Name: Default Sep 20 22:36:25.344026 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Id: b1b69806fd5f4885a824a58fa1d4432c Sep 20 22:36:25.344026 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: X-User-Name: tempest-TestVolumeBootPattern-1539651322-project Sep 20 22:36:25.344026 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: method: > Sep 20 22:36:25.344026 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: exception: Instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 could not be found. Sep 20 22:36:25.344026 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: action_args: {'id': '9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1'} Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: {{(pid=120474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 could not be found. Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 20 22:36:25.345042 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 20 22:36:25.346667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 20 22:36:25.346667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 20 22:36:25.346667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 20 22:36:25.346667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 20 22:36:25.346667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 20 22:36:25.346667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 20 22:36:25.346667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 20 22:36:25.346667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 could not be found. Sep 20 22:36:25.346667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:36:25.346667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 20 22:36:25.346667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:36:25.346667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 20 22:36:25.346667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 20 22:36:25.346667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 20 22:36:25.346667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 20 22:36:25.346667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 20 22:36:25.346667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 could not be found. Sep 20 22:36:25.346667 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: ERROR nova.api.openstack.wsgi Sep 20 22:36:25.348428 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: DEBUG nova.api.openstack.wsgi [None req-04d08be0-795d-4bb6-a43f-2c681afb2f17 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Returning 404 to user: Instance 9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 could not be found. {{(pid=120474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 20 22:36:25.348428 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: INFO nova.api.openstack.requestlog [None req-04d08be0-795d-4bb6-a43f-2c681afb2f17 tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1" status: 404 len: 111 microversion: 2.1 time: 0.030575 Sep 20 22:36:25.348428 dv-cinder-858276-1-iscsi devstack@n-api.service[120474]: [pid: 120474|app: 0|req: 566/1115] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 20 22:36:25 2022] GET /compute/v2.1/servers/9ebfdfa2-b87f-4a23-ba93-c62f8e96f6f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 20 22:36:26.636532 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: DEBUG nova.api.openstack.wsgi [None req-e6dbf924-9c29-4d89-ac5e-743cd4b1fb0b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] Calling method '.version_select at 0x7f24f6989940>' {{(pid=120473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 20 22:36:26.656085 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: INFO nova.api.openstack.requestlog [None req-e6dbf924-9c29-4d89-ac5e-743cd4b1fb0b tempest-TestVolumeBootPattern-1539651322 tempest-TestVolumeBootPattern-1539651322-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-262726890" status: 202 len: 0 microversion: 2.1 time: 0.022807 Sep 20 22:36:26.656690 dv-cinder-858276-1-iscsi devstack@n-api.service[120473]: [pid: 120473|app: 0|req: 550/1116] 10.222.0.16 () {58 vars in 1260 bytes} [Tue Sep 20 22:36:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-262726890 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)